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arbitrary  detection  region.  Related  parts  of  the  solution  to  Isaacs' 
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X.  Introduction 


This  report  documents  research  findings  for  the  time  period  30 
March  1970  to  19  June  1970  under  support  of  NR  276-027.  This  report 
discusses  applications  of  the  theory  of  differential  games  to  pursuit 
and  evasion  problems  of  Naval  warfare.  In  particular,  we  consider 
the  problem  of  surveillance-evasion.  A  companion  report  [47]  discusses 
other  research  findings  of  the  contract  period  with  respect  to  tactical 
allocation  problems.  "V 

The  goal  of  this  research  is  to  determine  the  circumstances 
under  which  an  evader  can  outmaneuver  a  pursuer  to  escape  as  a  function 
of  maneuverability.  The  solution  of  this  problem  leads  to  conditions 
ijfor  a  tracker  (destroyer)  to  be  able  to  keep  a  hostile  vehicle  (sub¬ 
marine)  under  constant  surveillance.  The  original  approach  was  to 
r.survey  the  previously  published  work  in  this  field  and  to  attempt  to 
extend  these  modelling  efforts.  Detailed  analysis  of  past  work  [14] 
has  uncovered  several  flaws  in  its  mathematical  development,  and, 
hence,  the  current  work  has  concentrated  on  establishing  a  firmer 
mathematical  basis  for  the  surveillance-evasion  aspect  of  the  more 
general  problem  of  pursuit  and  evasion.  This  work  has  created  a  broad 
base  for  future  possible  extensions. 


Warfare  is  characterized  by  decisions  being  made  on  the  dynamics 


of  combat  over  a  period  of  time  by  the  antagonists  towards  conflicting 
goals.  The  creation  of  game  theory  by  J.  von  Neumann  [48],  [49] 
(although  anticipated  by  E.  Borel  [21])  has  had  a  major  impact  on  the 
modelling  of  conflict  situations.  The  optimization  of  dynamical  systems 
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has  been  studied  under  the  calculus  of  variations  since  the  17th 
century.  However,  in  cases  where  inequality  constraints  are  present 
in  the  model,  these  powerful  classical  techniques  require  intricate 
modifications.  In  this  environment,  the  almost  simultaneous  develop¬ 
ment  in  the  early  1950's  of  differential  games  by  R.  Isaacs  [26],  [27], 
[28],  [29]  and  the  Pontryagin  maximum  principle  by  the  Russian  mathe¬ 
matician  L.  Pontryagin  [43]  has  been  enthusiastically  received  by 
military  operations  research  workers.  It  seems  appropriate  to  discuss 
these  techniques  briefly. 

a •  Differential  Games 

R.  Isaacs  was  the  original  developer  of  differential  games  in 
'ft  he  environment  of  RAND  in  the  early  1950’s  [26],  [27],  [28],  [29]. 

£  ‘  Although  not  acknowledged  in  his  book,  he  applied  Bellman's  ideas  of 

•  a  ;’_va 

/  i^ynamic  programming  [5]  to  a  limiting  case  of  a  multi-move  discrete 

/game.  A  brief  sketch  of  the  history  of  the  later  mathematical  develop- 
ment  of  differential  games  up  through  1965  is  contained  in  [22].  Isaacs 
published  a  major  work  in  1965  [30].  Y.  C.  Ho  [23]  has  reviewed  Isaacs's 
Tvork  and  discussed  its  relationship  to  deterministic  optimal  control  theory 
in  an  excellent  review  of  the  book  Differential  Games. 

The  subject  referred  to  as  differential  games  may  in  the  future 
be  called  zero-sum  deterministic  differential  games  within  the  emerging 
framework  of  "generalized  control  theory"  [24],  [25].  It  seems  appro¬ 
priate  therefore  to  review  briefly  the  characteristics  of  such 
optimization  models.  We  consider  two-controllers  who  manipulate  their 
own  control  variables  in  a  dynamic  system  whose  behavior  is  described 
by  a  system  of  differential  equations.  Each  controller  has  his  own 
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criterion  function,  but  these  are  related  by  summing  to  a  constant. 

Hence,  one  man's  loss  is  the  other's  gain.  There  is  one  information 
set  and  it  is  perfect  in  the  sense  that  all  past  history  is  known, 
opponent's  capability,  -»tc.,  except  the  instantaneous  strategy  of  the 
opponent.  It  is  within  the  framework  of  these  general  assumptions 
'that  idealized  surveillance-evasion  tactics  will  be  developed. 

The  work  of  Isaacs  has  been  the  major  source  of  ideas  for  the 
current  research.  Although  recent  work  has  been  more  mathematically 
precise  [6],  [7],  the  worked  examples  in  Isaacs  book  appear  to  this 
researcher  to  be  at  least  a  decade  ahead  of  the  development  of  those 
who  place  a  premium  on  precision.  Each  new  application  of  differential 
.game  theory  appears  to  motivate  several  new  concepts. 

b.  Generalized  Control  Theory 

^ _ _X  _  It  seems  appropriate  to  discuss  the  general  problem  of  pursuit 

and  evasion  within  the  broader  framework  of  "generalized  control  theory." 
As  noted  above,  two  notable  deficiencies  of  the  differential  game  models 
to  be  considered  in  this  work  are:  (1)  perfect  information  is  assumed 
and  (2)  the  model  is  deterministic.  Hence,  we  will  address  only  the 
kinematic  aspects  of  surveillance-evasion  and  will  not  consider  deception 
tactics . 

Within  the  past  sever?. 1  years  a  probabilistic  control  theory 
has  emerged.  W.  Fleming  [19]  recently  has  reviewed  this  field  and 
provided  an  extensive  (and  basic)  bibliography.  Willman  [50]  and  Behn 
and  Ho  [4]  have  extended  thesie  concepts  to  conflicting  dynamical  systems. 

»  Such  an  approach  applied  to  the  problem  at  hand  would  consider  detection 

probabilities  and  that  the  players  have  only  imperfect  knowledge  of  the 


state  of  the  system,  l.e.,  there  is  "noise"  superimposed  on  the  signal 
as  to  the  location  of  one's  opponent.  Such  extensions  are  beyond  the 
scope  of  the  current  modelling  effort,  but  are  noted  for  possible  future 
extensions.  The  deterministic  model  is  complementary  to  the  stochastic 
model  and  should  provide  insight  into  the  latter. 

c .  Application  to  Problems  of  Naval  Warfare 

We  have  seen  that  differential  games  provide  a  model  for  optimizing 
conflicting  dynamical  systems  over  a  period  of  time.  There  are  numerous 
applications  of  such  models  to  problems  of  Naval  warfare: 

(1)  interception  of  enemy  missiles  by  ABM's, 

-  <2)  allocation  of  Naval  fire  support  to  various  targets, 

(3)  allocation  of  Naval  airpower  to  ground-support  and 
strategic  targets, 

(A)  allocation  of  effort  in  searching  for  targets, 

(5)  surveillance  and  Cracking  of  hostile  vehicles. 

These  various  applications  are  noted,  since  the  solutions  of  all  these 
problems  involve  the  use  of  the  same  mathematical  technique,  differen¬ 
tial  game  theory. 

In  the  current  research,  we  study  the  problem  of  surveillance- 
evasion,  in  which  the  "pursuer"  attempts  to  maintain  contact  with  an 
"evader"  who  attempts  to  break  contact  by  moving  outside  the  detection 
capability  of  the  pursuer.  The  mathematical  structure  of  this  problem 
is  closely  related  to  that  of  pursuit  and  evasion  problems:  in  sur¬ 
veillance-evasion  the  problem  occurs,  for  example,  within  a  circle  and 
terminates  on  its  boundary,  while  in  pursuit  and  evasion  the  problem 
is  exterior  to  a  circle.  This  research  has  uncovered  some  subtle  differ¬ 


ences,  however. 
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The  discrete  models  of  multi-move  discrete  games  [5]  (generaliza¬ 
tion  of  dynamic  programming)  may  be  used  to  study  these  phenomena  under 
less  restrictive  assumptions.  The  value  of  the  differential  game 
approach  is  that  it  leads  to  explicit  expressions  relating  the  various 
system  parameters.  Thus,  the  basic  structure  of  optimal  policies  and 
tradeoffs  between  system  parameters  may  be  explicitly  exhibited. 

The  mathematical  techniques  of  control  theory  show  great  promise 
for  providing  insight  into  optimizing  the  dynamics  of  Naval  warfare. 
Many  previous  analyses  involving  classical  variational  method  may  be 
more  easily  done  and  extended  by  their  use.  As  an  example  of  this, 
jde  Guenin's  extension  [13]  of  Koopman's  results  [38]  on  the  optimum 


distribution  of  searching  effort  is  derived  in  Appendix  E  by  use  of  the 


Jon tryagin  maximum  P r inciple . 


•  ‘ 


II..  REVIEW  OF  1'KRT  1  N'ENT  1. ITKRATURF 


Tin-  published  literature  was  reviewed  to  find  out  what  had  been 
done  on  the  topic  of  surveillance-evasion  in  order  to  avoid  duplica¬ 
tion  of  research  effort.  We  do  not  attempt  a  comprehensive  review  of 
the  literature,  since  chat  was(not  the  purpose  of  th i, s  research.  How¬ 
ever,  some  major  works  are  highlighted  .  Literature  was  reviewed  in  two 
subject  areas.:  search  theory  and  differential  games. 

J.  Dobbie  [15]  has  published  a  rather  comprehensive  survey  of 
research  theory  in  1968.  He  indicated  that  the  only  published  work  on 
™i?the  tracking  operation  in  the  open  literature  was  by  Dobbie  himself 
,J  14 ] .  The  1966  paper  by  Dobbie  considers  the  kinematic  aspects  of 

•tot;  •  x 

■’Surveillance-evasion.  This  paper  is  the  primary  basis  for  the  present 
-research.  Dobbie  considers  a  sequence  of  problems,  formulated  as  differ¬ 
ential  games:  surveillance-evasion  for  a  circular  detection  region  of 
the  pursuer,  tracking  for  an  arbitrary  detection  region,  and  two  models 

V; 

in  which  recontact  is  possible  by  the  pursuer.  The  content  of  this  paper 
has  evolved  into  operational  Navy  doctrine  [16]. 

A  more  extensive  search  of  the  literature  did  not  yield  any  further  work 
^  on  tracking  operations  in  the  open  literature.  The  1966  survey  by 
Enslow  [18]  and  S.  Pollock's  selected  bibliography  [42]  were  consulted 
in  this  respect.  Both  these  surveys  were  consulted  by  Dobbie  for  his 
survey  article  [15].  A  recent  effort  at  the  University  of  Michigan  [41] 
was  also  examined  and  did  not  yield  any  new  references  on  the  tracking 
problem. 

The  differential  game  literature  was  consulted  for  general  mathe¬ 
matical  background  and. to  see  if  applications  to  tracking  could  be  found. 


7  The  applications  literature  vao  considered  of  prime  importance  rather 
than  the  development  of  the  mathematical  theory.  luancs's  1565  bock. 

{ 30]  remains  the  chief  source  of  examples  and  insight  into  technical 
questions  related  to  solving  actual  problems.  His  terminology  is  non- 
:  standard  to  control  theorists,  little  use  or  reference  to  the  classical 
variational  methods  is  made,  but  he  does  provide  an  extensive  theory 
■  naturally  motivated  through  examples.  Isaacs  homicidal  chauffer  problem 
Is  basic  to  pursuit  and  evasion  studies.  He  had  also  considered 
>T§the  tracking  problem  while  at  CNA  [31].  This  reference  does  not  contain 
any  analysis  and  the  condition  developed  for  surveillance  to  be  main- 
—Ttained  is  incorrect  (as  is  that  developed  by  Dobbie  [14]).  Isaacs' 9 
-"•^sketches  of  the  problem  indicate  that  he  did  note,  however,  the  termina- 
fUfe-lon  of  the  barrier. 

L.  Berkovitz's  paper  [6]  presents  an  extremely  rigorous  mathe- 
matical  development  of  differential  game  theory  but  presents  no  examples 
and  does  not  consider  most  of  the  significant  aspects  required  to  solve 
.^specific  problems.  Blaqui&re,  Gdrard,  and  Leitman  [8]  have  recently 
published  a  book  on  differential  games.  This  book  develops  the  theory 
from  a  geometric  point  of  view  and  is  an  extension  of  the  geometric 
•approach  to  control  theory  problems  developed  by  these  authors  over  the 
past  five  years.  This  previous  work  is  accessable  through  the  biblio¬ 
graphy  in  this  book.  Although  some  examples  are  given,  they  don't 
appear  to  be  representative  of  a  broad  experience  in  applications  as 
is  the  case  of  those  in  Isaacs'  book.  This  book  is  not  written  for  one 


not  already  acquainted  with  the  theory  and  is  not  useful  for  the  novice. 
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The  intimate  connection  between  differential  games  and  control 
theory  is  pointed  out  in  numerous  places  (see!  for  example  [6],  [23], 
[30]).  In  view  of  this  relationship,  much  of  the  optimal  control  theory 
can  be  broug  to  bear  on  differential  game  problems.  An  excellent 
review  of  deterministic  optimal  control  theory  with  an  extensive 
"bibliography  is  by  Athans  [1].  An  excellent,  concise  discussion  of  the 
relationships  between  control  theory  and  differential  games  is  contained 
in  the  review  of  Isaacs  book  by  Y.  C.  Ho  [23].  Other  articles  which 
contain  useful  review  material  are  by  Ho,  Bryson,  and  Baron  [22]  and 
also  Sarma  and  Ragade  [45].  Athans  and  Falb  [2]  have  written  an  excellent 
.-Introductory  text.  The  excellent  book  by  Bryson  and  Ho  [9],  besides 
'ibeing  an  easily  understood,  lucid  introduction  to  the  field,  contains 
many  advanced  topics  including  a  briei  introduction  to  differential 

Tgaraes. 

The  Russians  have  done  extensive  research  on  optimal  control/ 
'^differential  games  over  the  last  decade  [3].  An  excellent  survey  article 
delineating  numerous  fields  of  application  and  with  an  extensive  biblio¬ 
graphy  of  original  Russian  research  papers  is  by  Simakjva  [46].  Y.  C. 

Ho,  one  of  the  best  qualified  individuals  to  survey  the  current  Western 
-state-of-the-art,  has  documented  current  developments  (theoretical  and 
in  applications)  [25].  An  important  question  in  pursuit  and  evasion 
problems  is  "When  can  capture  occur?"  Isaacs  [30]  has  developed  several 
(equivalent)  criteria  for  determining  the  useable  part  of  the  terminal 
surface.  Recently,  L.  Meier  [40]  has  proposed  a  new  geometrical  criterion 
from  his  study  of  ABM  interception  of  re-entry  vehicles. 


t 
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III.  The  Surveillance-Evasion  Problem 


We  consider  an  idealized  model  for  the  problem  of  a  tracker 
(for  example,  a  destroyer)  keeping  a  hostile  vehicle  (for  example, 
a  submarine)  under  constant  surveillance.  The  maneuverabilities  (i.e.  , 
maximum  speed  and  turning  capabilities)  of  the  two  vehicles  lead  to  the 
appropriate  conditions.  When  these  conditions  are  met,  the  pursuer  can 
keep  the  Evader  under  close  surveillance.  The  Evader  cannot  do  anything 
to  break  contact  and  prevent  this  "tracking"  or  "tailing."  We  consider 
^an  extremely  idealized  model  with  perfect  information  on  the  location 
of  the  enemy  for  both  antagonists  and  a  circular,  "cookie-cutter" 


—detection  region  for  the  Pursuer. 


a.  Statement  of  the  Problem. 


7  We  consider  the  same  model  used  by  Dobbie  [14],  which  is  an  exten¬ 
sion  of  Isaacs's  model  [30].  There  are  several  flaws  in  the  earlier 


mathematical  development  of  Dobbie,  which  lead  to  an  incorrect  condition 
for  surveillance  to  be  maintained  and  an  incorrect  analysis  for  surveil¬ 
lance-evasion  with  arbitrary  detection  regions.  The  latter  has  the 
important  implication  that  the  involute  tactic  [lp]  may  not  be  optimal 
for  holding  contact  in  real  world  situations  where  sonar  capabilities 
■generate  a  non-circular  detection  region.  It  should  also  be  noted  that 
the  brief  work  by  Isaacs  on  this  problem  also  yielded  the  wrony  surveil¬ 
lance  condition.  Hence,  the  purpose  of  the  present  research  is  to  set 
such  analysis  on  a  firmer  mathematical  basis. 

In  the  model  the  Pursuer  is  faster  than  the  Evader,  who  does, 
however,  possess  an  advantage  in  turning  capability.  We  assume  a 
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circular  "cookie-cutter"  detection  region  for  the  Pursuer,  who  detects 
the  Evader  with  probability  one  when  they  are  less  than  a  distance  d 
apart.  The  goal  of  the  Evader  is  to  break  contact  as  quickly  as  possible 
..by  moving  out  of  the  circular  detection  region  of  the  Pursuer,  who 
attempts  to  maintain  contact  as  long  as  possible.  We  define  the  follow¬ 
ing  notation: 

subscripts:  1  refers  to  Pursuer,  2  refers  to  Evader 
s^  *  Pursuer's  speed  with  maximum  w^ 

“  Evader's  speed  with  maximum  w^ 


R  *  minimum  turning  radius  of  the  Pursuer 

-  fraction  of  maximum  course  curvature  employed  by  Pursuer 

(<t  •  -1  corresponds  to  left  turn  with  minimum  turning  radius) 

.  -  -  Evader's  heading  relative  to  that  of  Pursygy 

d  -  radius  of  Pursuer's  detection  region 

T  -  time  for  Evader  to  escape  (reach  circle,, J . f 

Pursuer)  ' :  ' 

Thus,  the  problem  facing  the  Pursuer  is 


T 

max  min  |  dt, 
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subject  to  the  equations  of  motion  of  the  two  vehicles.  It  is  conven¬ 
ient  to  adopt  a  relative  coordinate  system  for  two  reasons:  (1)  the 
dimension  of  the  problem  is  reduced  and  (2)  such  a  coordinate  system 
is  standard  in  Naval  operations.  In  this  relative  system  the  Pursuer 
is  located  at  the  origin  and  has  a  verticle  heading.  Thus  the  coordinate 
system  is  "carried  by  the  Pursuer."  In  this  system  the  problem  is 


max  min  dt  with  T  unspecified, 
*’8l  *‘s2  0 


subject  to: 


— ~  +  s2  sin  iji. 


dy  V* 

diM  —  +  B* CQS  *  -  ?i* 


.  I  :.i.: n  ■  Ti  i: 


and  -1  s  $  £  1, 


0  *  Si  *  wl* 


0  £  £  w2  <  w^, 


with  initial  location  of  evader 


x(t  -  0)  *  Xq , 


y (t  »  0)  »  yQ, 


l 


mir  *  ™:  :i-K-'-~'H4cr'i if: it  -~.il.- . 


Jir  '  'V  r  •/.  =4f 

7:  '  r  7%  ■„  "ir* '  ')•? 

,  Jua  ;m  j Jf  j: 

i1;- 


and  terminal  surface  defined  by 


xz(T)  +  yz(T)  "  dz. 


r»sThese  equations  are  derived  in  Appendix  A,  since  the  soluti  a  ^procedure 

■/  f 

relies  on  an  understanding  of  the  geometry  of  this  relative  coordinate 


,  system.  ./  / 

b .  Games  of  Degree  and  Games  of  Kind. 


'.V:a  In  this  section  we  discuss  the  concepts  of  a,  game  of  degree  apd 

a  game  of  kind.  The  purpose  of  this  discussion  is  to  explain  that  in 

/  '  • 

order  to  solve  a  game  of  kind  one  must  solve  that  part  of  a  correspond¬ 
ing  game  of  degree  into  which  the  game  of  kind  has  been  imbedded.  The 
■common  part  of  optimal  strategies  for  these  two  games  is  the  barrier, 


i.e.  boundary  of  dom.  in  of  controllability. 
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Isaacs  ([30]  p.  35)  defines  a  game  of  degree  as  one  with  a  contin¬ 
uous  range  of  payoffs.  In  the  surveillance-evasion  game,  the  formulation 
of  the  previous  section  is  a  game  of  degree  with  time  of  escape  as  the 
payoff.  A  game  of  kind  is  one  with  a  finite  number  of  payoff  values.  The 
reaching  of  each  particular  terminal  state  yields  a  single  payoff  value. 
Such  is  the  case  if  we  consider  the  payoffs  as  +1  if  contact  is  broken 
and  -1  if  the  Evader  can't  break  contact.  Blaquiere  et  al  ([8]  pp.  9-10) 
have  a  similar  definition  except  that  a  quantitative  game  (game  of  degree) 
---’is  a  game  in  which  there  is  a  common  target  set  for  both  pursuer  and 
evader.  It  should  be  noted  that  there  are  attrition  games  in  the  liter¬ 
ature  for  which  this  definition  is  inadequate  [47]. 

We  define  the  domain  of  controllability  of  a  terminal  state  to  be 

_ jhat  subset  of  the  initial  state  space  from  which  trajectories  lead  to 

this  terminal  state  for  all  admissible  strategies  of  the  player  for 
which  this  terminal  state  is  unfavorable  when  the  extremal  strategy  of 
his  adversary  is  played.  By  an  extremal  strategy,  we  mean  a  strategy 
determined  on  an  extremal  trajectory,  which  is  a  path  on  which  the 
necessary  conditions  for  optimality  [6]  are  almost  everywhere  satisfied. 
The  barrier,  being  the  boundary  of  the  domain  of  controllability,  is 
the  trajectory  which  leads  to  the  boundary  of  the  useable  part  of  the 
terminal  surface.  The  useable  part  of  the  terminal  surface  is  that  part 
of  the  terminal  surface  to  which  there  are  paths  from  the  state  space 
(see  Isaacs  [30]  p.  83  and  also  Appendix  B). 

Thus  Isaacs  ([30]  p.  13)  imbeds  a  game  of  kind  into  a  game  of 
degree.  We  may  consider  a  game  of  degree  as  a  game  of  kind  in  which 
the  prerogative  of  each  of  the  antagonists  is  exercised  to  do  his  "best." 
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The  point  being  developed  is  that  one  muat  know  how  to  solve  a 

game  of  degree  In  order  to  solve  the  corresponding  game  of  kind.  Other 
uses  of  the  game  of  degree  solution  are 

(1)  show  path  of  system  when  prerogatives  are  exercised, 

(2)  when  the  prerogative  is  not  exercised  by  one  party,  indicates 
direction  system  will  move. 

The  latter  remark  is  the  motivation  for  Isaacs's  concept  of  a  semi- 
permeable  surface  ([30]  pp.  70-71). 

Let  us  discuss  further  the  concept  of  a  semi-permeable  surface. 


since  even  one  of  the  leading  control  theorists  has  overlooked  the  ,  ' 

reason  for  this  concept  in  his  excellent  review  of  Isaacs's  book  [23]. 
Initially,  we  consider  a  game  of  degree  and  a  simply-connected 
domain  in  the  state  space.  When  the  problem  has  a  solution,  this 
^domain  is  covered  by  a  field  of  extremals  [17].  We  can  transform  our 
original  problem  to  one  with  terminal  payoff,  so  that  the  value  of  the 
game,  denoted  by  V,  will  be  constant  along  an  extremal.  Consider  now 
Figure  1.  Three  extremals  with  the  accompanying  value  of  the  game  are 
shown.  If  extremal  strategies  are  used  by  both  players,  the  trajectory 
remains  on  the  extremal.  If  the  Pursuer  uses  his  optimal  strategy  $*, 
but  the  Evader  uses  a  non-optimal  strategy,  then  the  course  of  the 
system  is  steered  to  lower  payoff  values  and  similarly  when  the  roles 
are  interchanged. 

To  reiterate,  the  semi-permeable  surface  is  a  surface  in  the 
state  space  for  which  each  player  controls  the  penetration  by  the  path 
of  the  system  by  use  of  his  optimal  strategy.  When  a  player  employs 
his  optimal  strategy,  his  opponent  can't  steer  the  system  to  a  more 
favorable  position  by  any  strategy,  and  if  he  doesn't  use  his  own  optimal 


strategy,  a  less  favorable  outcome  will  result.  This  situation  Is  a 
consequence  of  the  criterion  functional  having  a  saddle  point  when 
optimal  strategies  are  used.  The  purpose  of  Isaacs'  Introduction  of  this 
concept  of  a  semi-permeable  surface  is  that  the  barrier,  the  only  place 
where  optimal  strategies  are  determined  for  a  game  of  kind,  is  a  semi- 
permeable  surface. 

The  barrier  is  a  surface  in  the  state  space  (Isaacs  refers  to  the 
state  space  as  the  "playing  space")  which  divides  the  capture  and  escape 
zones  when  both  exist.  The  global  answer  to  the  capture-or-escape  ques¬ 
tion  depends  on  whether  or  not  the  barrier  divides  the  state  space  into 
two  parts.  Hence,  we  know  that  if  we  can  show  that  the  barrier  termi¬ 
nates  without  having  done  this,  the  entire  state  space  is  either  all 
capture  zone  or  all  escape  zone.  For  the  problem  at  hand  (surveillance- 
evasion)  this  means  that  there  is  probably  no  surveillance  zone  if  the 
barrier  so  terminates.  Termination  of  the  barrier  is  discussed  in 
Isaacs's  book  [30]  on  pages  210-214.  The  argument  given  there  that  a 
barrier  terminates  due  to  an  abrupt  change  in  direction  (see  Figure  2) 
is  best  understood  by  recalling  that  a  game  of  kind  is  imbedded  into  a 
game  of  degree.  In  this  game  of  degree?  each  behavior  would  lead  to 
more  than  one  extremal  at  a  point  in  the  state  space. 

c.  Connection  with  the  Homicidal  Chauffer  Game 

The  research  philosophy  has  been  to  employ  a  "broad"  approach  to 
specific  problems  by  drawing  upon  theory  from  diverse  fields.  For 
example,  consideration  of  the  geometric  properties  of  complex  numbers 
has  led  to  a  geometric  way  to  construct  extremal  paths  in  the  homicidal 
chauffer  game.  This  led  to  the  correct  condition  for  termination  of  the 
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Figure  2.  Conditions  for  Termination  of  Barrier. 
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barrier  (and  hence  the  existence  of  no  surveillance  region),  which  had 
eluded  both  Dobbie  [14]  and  Isaacs  [31]. 

Consideration  of  a  sequence  of  closely  related  problems  has  been 
attempted  to  try  to  learn  from  their  common  points.  Three  such 
closely  related  problems  are : 

(1)  destroyer  to  fixed  destination, 

(2)  homicidal-chauffer  game, 

(3)  surveillance-evasion  game. 

In  working  on  the  surveillance-evasion  game,  consideration  of  the  first 
two  problems  has  proven  to  be  useful.  The  study  of  these  has  many 
points  in  common  with  the  surveillance-evasion  game.  Hence,  analysis 
"of  these  problems  is  presented  in  Appendices  B  and  C  as  background 
material. 

Specifically,  the  relationship  of  the  homicidal-chauffer  game  and 
the  surveillance-evasion  game  is  as  follows  (as  first  pointed  out  by 
Isaacs  [31]).  Consider  the  terminal  surface  of  the  homicidal-chauffer 
game.  It  is  a  circle,  and  the  state  space  for  the  game  is  exterior  to 
/this  circle.  For  the  surveillance-evasion  game,  the  state  space  is 
interior  to  the  terminal  surface  with  the  useable  and  non-useable  parts 
of  the  terminal  surface  being  interchanged.  A  point  worth  noting  (again 
first  pointed  out  by  Isaacs  [31])  is  that  most  pursuit  differential  games 
can  be  converted  into  surveillance  games  by  turning  the  analysis  inside 
out. 

d.  Solution  of  the  Surveillance-Evasion  Game 

In  this  section,  we  show  the  solution  to  the  game  of  degree.  Analysis 
details  are  presented  in  Appendix  D.  As  noted  in  Section  Illb,  we  may 


.1.8 


consider  the  game  of  kind  as  imbedded  in  a  game  of  degree.  Hence,  when 
we  consider  the  problem  as  a  game  of  kind  (Is  it  possible  for  surveil¬ 
lance  to  be  maintained?),  optimal  strategies  of  the  game  of  degree  only 
apply  on  the  barrier  for  the  game  of  kind. 

Before  discussing  briefly  the  geometric  aspects  of  solution,  let  us 
summarize  the  new  results  of  the  current  research: 

(1)  correct  condition  for  surveillance  to  be  maintained, 

(2)  new  geometric  construction  for  escape  paths, 

(3)  extension  of  model  to  non-circular  detection  region. 

An  important  question  to  be  answered  by  the  model  is,  "Under  what 
circumstances  can  surveillance  be  maintained?"  The  correct  answer  is 
when 

^1  H(/l  -(w2/w1)i!  +  2(w2/w1)(tt  -  U)),  (2) 

Where 

cos  U  *  w2^wl  an<*  0  *  ^  *  it/ 2. 

Dobbie  [14]  and  Isaacs  [31]  had  derived  different  conditions. 

We  also  have  discovered  a  geometric  interpretation  for  the  optimal 
escape  paths.  For  0  £  t  <  2R,/w^(n  -  u) ,  the  path  equation  may  be 

!T< 

written  as 

baas*  . 

x(x)~  r]  cos  w.  t/R  sin  w.  t/r] f (d  -  t  w„)sin  u  -  R 

-  1  A  (3) 

y(x)  [-sin  w^  t/R  cos  w^  t/rJ  (d  -  t  W2)cos  u 

where  U  £  u  £  n/2  and  cos  U  *  w2^wl*  0  £  U  £  ir/2. 

x  «  T  -  t  i.e.,  time  measured  backwards  from  escape. 


This  equation  says  that  the  Evader's  location  on  an  optimal  escape  path 
may  be  obtained  as  follows  (with  reference  to  Figure  3) : 

(1)  locate  escape  point  on  detection  circle,  for  example  A^, 

<2)  point  moves  along  line  OA^  with  speed  towards  0; 

at  time  t  it  io  at  A^, 

(3)  rotate  A-  through  angle  w.  r/R  in  negative  sense  about 
point  (R,0) ;  this  yields  a^,  the  point  on  the  optimal 
trajectory  at  time  i , 

(4)  maximum  possible  rotation  is  through  angle  2  (tt  -  u) ,  where 
u  is  angle  between  line  from  escape  point  on  detection 
circle  to  0  and  the  positive  y-axis. 

At  a  later  time  the  point  has  moved  to  A^  and  is  rotated  to 

on  the  escape  path.  When  the  optimal  trajectory  is  the  barrier, 
Jthere  is  an  additional  special  geometric  property  of  the  escape  path. 

^t  may  be  shown  that  the  barrier  is  an  involute  to  a  circle  of  radius 
R  W2^W1  w^th  center  (R,0).  Hence,  at  each  point  on  this  curve,  the 
^normal  is  tangent  [12]  to  the  circle  just  mentioned.  This  is  illustrated 
fox  point  A^  in  Figure  3.  For  non-barrier  escape  paths  (consider  path 
B1B2B3^’  curve  *8  not  an  involute  to  any  circle,  but  the  same  geo¬ 

metric  construction  holds. 

This  geometric  construction  provides  deeper  insight  into  the 
geometry  of  escape  paths.  (A  similar  geometric  construction  is  possible 
for  both  the  destroyer  to  fixed  destination  problem  and  the  homicidal 
chauffer  game.)  It  suggests  that  there  may  be  a  conjugate  point  [44] 
to  the  escape  point  on  an  optimal  trajectory,  i.e.,  neighboring  extremals 
intersect  at  this  point.  Such  a  point  is  in  Figure  3.  Further 

investigation  of  this  phenomena  seems  warranted  but  time  hasn't  permitted 
it.  The  geometric  construction  suggests  that  the  problem  may  be  more 
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easily  solved  in  relative  polar  coordinates,  but  this  has  not  been 
explored  too  far  as  yet.  A  similar  construction  results  when  the  solu¬ 
tion  is  extended  past  the  time  restriction  above.  We  note  that  the 
y-axis  is  a  line  of  symmetry  for  this  problem. 

We  have  briefly  examined  this  problem  for  a  non-circular  detection 
region.  Our  research  indicates  that  Debbie' s  [14]  approach  is  incorrect 
and  that  the  problem  should  be  re-examined  for  some  simple  non-circular 
geometries.  This  implies  that  the  involute  tactic  [16]  may  not  be 
optimal  for  non-circular  detection  regions.  The  justification  for 
these  statements  is  given  in  the  next  section. 

We  now  consider  the  geometry  of  the  solution  to  the  tracking  pro- 
^v^blem.  We  shall  describe  the  optimal  trajectories  (as  far  as  the  current 
iTesearch  has  progressed)  and  optimal  tactics.  The  type  of  geometric 
"Tf'Tcon figuration  for  the  escape  paths  depends  on  the  craft  speeds,  the 
Pursuer's  minimum  turning  radius,  and  the  radius,  d,  of  his  detection 
-aregion.  We  let 

,  d1  =  R{  /l  -(w2/w1>/  +  2(w2/w1)(tt  -  U  )},  (A) 

!•  '*  ' 

d2  =  R{<4  -(w2/w1)ii  +(w2/wx)(  J  7T  -U)+  1},  (5) 

where 

cos  U  *  w2^wi  ant*  0  *  1*  *  tt/2. 

Then,  there  are  three  cases  (see  Appendix  D  for  details) : 

(1) 

(2) 

(3) 


d  <  d^  no  surveillance  region  (of  type  in  next  two  cases) 

dx  «  d  c  d2 
d2  i  d 


barrier  meets  the  negative  y-axis. 
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These  three  cases  are  shown  in  Figures  4  through  6.  In  all  cases  the 
barrier  is  the  involute  to  a  circle  of  radius  R  w^/w^  and  center 
(+  R,Q).  The  tangents  to  these  circles  from  0  are  of  special  signi¬ 
ficance.  The  escape  paths  are  symmetric  with  respect  to  the  y-axis, 
and  hence  we  discuss  the  solution  only  in  the  right  half-plane.  Let 
u  be  the  angle  between  line  from  escape  point  on  detection  circle  to 
0  and  the  positive  y-axis.  The  equation  of  escape  paths  is  given 
by  (3)  for  range  of  t  given  there. 

In  case  (1) ,  the  barrier  terminates  when  it  reaches  the  circle 
of  which  it  is  the  involute  (see  AA'  in  Figure  4).  Paths  which  terminate 
between  A  and  B  are  given  by  equation  (3),  but  it  hasn't  been  ascer¬ 
tained  whether  such  paths  terminate  abruptly  (yielding  a  dispersal  surface) 
for  t  s  ■  2  R/w^ (tt  -  u)  due  to  intersection  of  neighboring  extremals. 
Escape  paths  have  not  been  traced  backwards  for  t  i  x^.  Thus,  although 
there  is  no  surveillance  region  of  the  type  for  cases  (2)  and  (3) ,  the 
optimal  escape  paths  have  not  been  determined  from  all  of  the  state  space, 
and  there  may  be  "surveillance  pockets"  present.  Hence,  we  have  estab¬ 
lished  the  Evader's  escape  tactics  only  in  the  small  region  AA'CB,  when 
he  is  close  to  the  limits  of  the  Pursuer's  detection  capability.  One 
disturbing  feature  of  this  model  is  that  for  escape  at  x(T)  »  d  sin  u 
and  n/2  <  u  <  3/2  r,  the  Pursuer's  optimal  tactic  is  to  stop  dead  in 
the  water,  s^  ■  0.  Such  escape  paths  (shown  in  Figure  4)  terminate 
at  D,  E,  and  F  and  originate  from  0. 

In  case  (2) ,  the  barrier  divides  the  state  space  into  a  surveillance 
zone  and  an  escape  zone.  For  0  S  x  £  x^  *  2  R/w^(ir  -  U)  t  the  Pursuer 
uses  4>  -  1  (sharpest  turn  to  right).  For  x  >  x^,  the  Pursuer  uses 
$  »  -1,  and  the  barrier  is  given  by 
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(6) 

which  may  also  be  shown  to  be  an  involute  unwinding  from  a  circle  with 
center  at  (-R,0)  and  radius  R  w2/w^.  At  t  -  x^,  the  point  D  is 
always  located  on  the  lower  tangent  to  the  circle  as  shown  in  Figure  5. 

It  lies  between  0  and  D'  (when  d  ■  d^,  it  is  at  D').  The  paths 

terminating  between  A  and  B  intersect  each  other,  but  complete 

details  have  not  been  worked  out  as  yet.  Again,  for  escape  at  x(T)  •  d  sin  u 

and  ir/2  <  u  <  3/2  it,  the  escape  paths  are  straight  lines  terminating 

at,  for  example,  F,  G,  H,  and  I.  Paths  in  the  vicinity  of  ODE  (a  "pocket") 

haven't  been  worked  out. 

In  case  (3),  the  Pursuer  only  usee  $  *  1  on  the  barrier,  since 
it  intersects  the  negative  y-axis  before  x  ■  x^.  When  d  «*  d2>  the 
barrier  is  tangent  to  the  negative  y-axis.  Other  aspects  are  similar 
to  above.  This  case  is  shown  in  Figure  6. 

1 

e .  Shortcomings  of  Previous  Work 

The  differential  game  solution  techniques  of  the  current  research 
differ  from  Dobbie's  approach  [14].  It  is  the  purpose  here  to  discuss 

such  differences,  since  some  of  our  results  differ  from  his.  Dobbie, 

considering  a  game  of  kind,  uses  Isaacs's  "game  of  kind  approach," 

(see  chapter  8  in  [30]).  As  we  have  discussed  above,  Isaacs  developed 

this  approach  by  imbedding  such  a  problem  in  a  game  of  degree.  The 

analytic  details  of  many  steps  in  the  solution  of  a  game  of  kind  (see 

[30]  pp.  203-210)  will  be  seen  to  be  the  same  as  employed  here  (game 

of  degree)  with  the  vector  of  dual  variables  p  replaced  by  the  normal 
■+ 

to  the  barrier  v  The  Hamiltonian  is  also  modified  slightly.  However, 


x(t)+R  cos  Wj  (t-t^/R  -sin  w^t-t^/R  x(t^)4w2  (x-t^)cos  (tt/2- 1>+R 

y(x)  [sin  wx <x— Tj ) /K  cos  w^t-t^/rJ  [y(x  ^-w^T-x^sinOr^-U) 


rid 
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two  important  aspects  are  not  adequately  treated  in  Dobbie's  work  [14]: 

(1)  termination  of  the  barrier  (see  [30]  pp.  210-214), 

(2)  construction  of  the  barrier  (see  [30]  pp.  214-215). 

As  we  have  discussed  above  in  section  Illb  (see  also  Appendix  B) , 
whether  or  not  there  is  a  surveillance  region  is  dependent  upon  whether  the  barrier 
terminates  or  not.  This  aspect  of  solution  is  ignored  by  Dobbie,  whose 
condition  for  the  existence  of  a  surveillance  zone  should  be  contrasted 
with  ours. 

A  more  serious  criticism  must  be  leveled  at  Dobbie' s  method  of 
determining  the  useable  part  of  the  terminal  surface,  denoted  as  UF. 

Dobbie  does  not  make  use  of  the  fact  that  every  game  of  kind  is  imbedded 
in  a  game  of  degree.  Hence,  he  does  not  recognize  that  the  solution 
depends  on  the  geometry  of  the  detection  region  and  erroneously  concludes 
that  the  solution  for  a  circular  detection  region  would  apply  for  an 
arbitrary  detection  region  ([14]  p.  177).  The  purpose  of  criticism 
of  Dobbie' 8  results  is  to  point  out  that  the  surveillance-evasion  problem 
has  not  been  solved  for  arbitrary  detection  regions  and  suggest  such  a 
task  as  a  future  research  effort. 

Let  us  discuss  why  the  solution  depends  on  the  geometry  of  the 
detection  region.  Isaacs  ([30]  p.  215)  states  a  criterion  for  the 
construction  of  the  barrier:  the  normal  to  the  barrier  coincides  with 
the  normal  to  the  terminal  surface.  This  leads  to  our  major  criticism 
of  this  pioneering  effort:  Dobbie  tried  to  extend  the  model's  solution 
for  a  circular  detection  region  to  arbitrary  detection  regions  when 
such  an  extension  is  not  justified. 
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We  consider  a  second  argument  (from  optimal  control  theory)  for 
solution  dependence  on  geometry  of  detection  region.  Dobbie  (p.  174) 
says,  "Let.  t  *  0  at  a  point  A  of  a  barrier  for  which  yv^  -  xv^, 
so  that  the  normal  lies  along  the  radial  line  OA."  Since  t  ■  0  is 
time  of  escape,  the  barrier  is  tangent  to  the  detection  region  at 
escape  (normal  of  barrier  is  perpendicular  to  escape  surface)  for  a 
circular  detection  region  but  does  not  have  to  be  for  an  arbitrary 
detection  region.  It  is  well-known  in  control  theory  (see  [2]  p.  290) 
that  p  is  parallel  to  n  where  p  is  vector  of  dual  variables  at 
terminal  surface  and  n  is  normal  to  terminal  surface  (pointing  inward 
to  state  space).  For  the  problem  at  hand,  the  normal  to  the  barrier 
(in  Dobbie 's  notation)  is  parallel  to  p.  Hence,  this  normal  must  be 
perpendicular  to  the  detection  region  at  the  moment  of  escape,  and  this 
condition  may  be  violated  in  Dobbie' s  analysis  for  an  arbitrary  detection 


region. 
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IV .  Conclusions  and  Future  Extensions 


Here  we  summarize  what  we  have  done  and  suggest  possible  future 
research.  We  think  that  we  have  established  more  firmly  the  mathematical 
basis  of  a  certain  type  of  surveillance-evasion  model.  Specifically, 
we  have  accomplished  the  following: 

(1)  parts  of  the  surveillance-evasion  game  of  degree  have  been 
solved  (A  disturbing  aspect  is  that  the  Pursuer  stops  still 
in  the  water  for  those  cases  when  the  Evader  escapes  "behind 
him."). 

(2)  correct  condition  developed  for  surveillance  zone  to  exist, 

(3)  devised  geometric  construction  for  describing  optimal  escape 
paths , 

(4)  showed  that  Dobbie's  extension  of  the  solution  to  arbitrary 
detection  regions  was  incorrect. 

Based  on  this  research  effort  we  suggest  the  following  as  possible  future 
work: 

(1)  develop  further  the  solution  to  the  game  of  degree  (This 
would  provide  insight  into  Evader  escape  paths  and  tactics, 
especially  for  those  cases  when  contact  can  be  broken,  i.e., 
no  surveillance  zone.), 

(2)  examine  problem  for  non-circular  detection  regions  (This 
would  allow  actual  sonar  patterns  to  be  more  accurately 
described  in  the  model.  We  suggest  that  analysis  first 
consider  an  elliptical  detection  region  and  then  try  to 
generalize  results.), 

(3)  consider  surveillance-evasion  game  in  relative  polar 
co-ordinates  (This  approach  is  suggested  from  new  geometrical 
construction  noted  above  and  is  related  to  tasks  (1)  and 

(2)  above.), 

(4)  study  extensions  of  basic  9urvelllance-evasion  scenario, 

(a)  formulate  problem  which  eliminates  a  stationary  Pursuer 
as  an  optimal  tactic, 

(b)  study  effects  of  Evader  having  maneuverability  limita¬ 
tions  (What  quantitative  effect  does  this  have  on 
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condition  for  Pursuer  to  have  surveillance  zone?  This 
would  be  an  application  of  the  extension  of  Isaac's 
homicidal  chauffer  game  called  the  game  of  two  cars 
[30]  p.  237.), 

(c)  study  problem  of  two  Pursuers  against  a  single  Evader, 

(d)  develop  other  models  of  tactical  Interest  and  study 
other  extensions  in  the  literature. 


i 

1 
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APPENDIX  A.  DERIVATION  OF  BASIC  EQUATIONS. 


In  this  appendix  we  derive  equations  (1)  of  the  main  text.  Even 
though  these  equations  are  briefly  derived  on  p.  30  of  [30],  we  feel 
that  the  current  derivation  has  increased  our  understanding  of  the 
relative  coordinate  system  and  may  be  useful  to  others.  First  we 
translate  the  restriction  of  a  finite,  non-zero  minimum  turning  radius 
into  a  restriction  of  the  maximum  rate  of  change  of  direction.  Next, 
we  develop  the  basic  equations  in  a  fixed  reference  frame.  Finally, 
the  equations  are  transformed  to  the  relative  coordinate  system. 

a.  Implication  of  Finite,  Non-zero  Minimum  Turning  Radius. 

™  We  consider  motion  of  a  point  in  the  plane  when  the  radius  of 
curvature  is  bounded  below  and  greater  than  zero.  We  assume  that  the 
"point  Is  moving  with  constant  speed  w  and  adopt  a  fixed  rectangular 
frame  of  reference  as  shown  below.  The  curve  is  given  parametrically 


x  ■  x(t)  and  y  =  y(t),  where  t  is  time.  Hence,  the  velocity 
components  are  given  by 
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dx 

dt 


w  cos  0, 


i £ 

dt 


w  sin  0. 


(Al) 


If  there  were  not  restrictions  on  maneuverability,  then  we  could  choose 
0  *  0(t)  in  a  completely  arbitrary  manner.  Let  us  now  see  how  a  lower 

J  Q 

bound  on  the  turning  radius  restricts  0  »  6(t)  through  • 

at 

We  consider  a  curve  in  the  plane  given  by  x  -  x(s)  and  y  ■  y(s), 
where  the  parameter,  s,  is  arc  length.  The  curvature .  x ,  is  defined 

.V’ 

as  the  rate  of  change  of  angle  of  inclination,  0,  with  respect  to  arc 
length  (see  pp.  280-282  in.  [12]) 

? Hr. ?"?!•' :  '  •  T  ' 


de 

ds’ 


where  the  angle  of  inclination  is  shown  in  the  figure  below  and  the 
slope  of  the  curve  is  related  to  0  by  tan  0  ■ 
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The  radius  of  curvature  of  the  curve  at  a  point  Is  defined  by  p  -  1/k. 
The  restriction  that  the  radius  of  curvature  is  bound  below  may  be 
expressed  as  p  i  R  >  0  or  1/R.  Introducing  a  new  "turning" 

variable,  we  may  write  this  as  an  equality 


k  ■  $/R  where  -1  s  <J>  £  1, 


Since  time  is  a  more  convenient  parameter  than  arc  length,  we  have 


d8  =  d6  dt_  ^  de,ds 
ds  dt  ds  dt  at* 


Recalling  that  ds  ■  /dsz  +  dy7,  we  have  that 


ft 


by  use  of  (Al)  .  Combining  (A2),  (A3),  and  (A4),  ws  obtain 


UD  , 

“  $w/R  where  -1  &  <p  t  1, 


which  is  the  desired  restriction  on  0(t)  from  the  lower  bound  on 
the  "turning"  radius.  We  summarize  the  equations  of  motion  in  a  plane 
when  there  is  a  lower  bound  on  the  radius  of  curvature,  R. 


dx 

^  ■  w  cos  6, 


“  w  sin  0, 


$w/R  where  -1  £  <f>  i  1, 


b.  The  Relative  Coordinate  System. 

It  Is  convenient  to  adopt  a  relative  coordinate  system,  one  that 
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moves  with  the  observer.  Our  development  is  the  same  as  Koopman's 

([38]  or  again  [39]).  We  consider  first  the  simple  case  of  motion  at 

fixed  speed  and  course  for  an  observer  (who  carries  the  coordinate 

system  with  him)  and  a  target.  Assuming  both  the  observer  and  the 

target  move  at  constant  speeds  in  straight  lines,  we  let 

v  ■  speed  of  observer  in  knots  (ocean  or  true  speed) , 

u  *  speed  of  target  in  knots  (ocean  or  true  speed), 

w  «■  speed  of  target  relative  to  observer  in  knots. 

The  corresponding  vectors,  v,  u,  and  w,  describe  the  constant 

motion.  We  note  chat  the  vector  difference,  w  *  u  -  v,  gives  the 

motion  of  the  target  relative  to  that  of  the  observer.  Figure  A1  shows 

the  relationship  between  true  and  relative  velocities  and  angles.  In 

Figure  A1  the  vectors  are  "laid  off"  from  the  same  point.  The  actual 

situation  is  shown  in  Figure  A2. 

Thus,  we  consider  a  coordinate  system  moving  with  the  observer 
(see  Figure  A3) . 

(or  Pursuer) ’  The  y-axis  of  this  coordinate  system  is  coincident  with 
the  observer's  velocity  vectory.  P  is  a  fixed  point,  located  at  the 
origin.  The  point  E  (which  may  be  either  moving  or  stationary  in 
the  fixed  reference  frame)  moves  relative  to  P.  We  later  derive  the 
equations  of  motion  of  E  relative  to  P.  We  note  that  in  this  rela¬ 
tive  coordinate  system,  there  are  two  factors  contributing  to  E's 
mot  ion : 

(1)  rectilinear  motion  of  P  and  E, 

(2)  rotation  of  coordinate  system  when  P  turns. 


j 


Evader,  E 


Pursuer,  P< 


^  is  relative  heading  of  Evader 


Figure  A3.  The  Relative  Coordinate  System. 


c.  The  Basic  Equations  in  a  Fixed  Reference  Frame. 

We  consider  the  motions  of  a  Pursuer,  P,  and  Evader,  E,  in 
a  stationary  coordinate  system.  We  consider  the  problem  of  the  Evader 
trying  to  break  contact  with  a  Pursuer  by  moving  out  of  the  Pursuer's 
detection  region,  which  is  circular  with  radius  d.  We  use  the 
notation  defined  in  section  Ilia,  of  the  main  text.  The  situation  is 


shown  below. 


s  ?' 


_.\:c 


_ 
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We  have  seen  above  that  the  non-Eero  minimum  turning  radius,  R,  o 
the  Pursuer  yields  a  restriction  on  the  rate  of  change  of  a 


d  i 

— -  “  $s,  /R  where  -1  £  <f  £  1 
at  1 


Hence,  in  the  stationary  coordinate  system  the  surveillance-evasion 
problem  may  be  stated  as 

T 


max  min  |  dt  with  T  unspecified, 

*.S1  e,s2  o 

f  dx^ 

subject  to:  =  s1  cos  a, 


■'dy, 

if  ■' _ ± 

dt 


s^  sin  a, 


ii  ■  ♦s,/R  where  -1  &  4>  £  1, 

dt  1 

dx2 

v  dT  ’  S2  C°S  B> 


^2 

dt 


s2  sin  8, 


where  0  £ 


0  s  s2  s  w^ 


with  initial  conditions 


x^t-0)  =  x«  ,  yt(t=0)  -  y°  ,  a(t»0)  -  aQ, 

x2(t»0)  =  x°  ,  y2(t-0)  -  y°, 
and  terminal  condition 

i  2  _  a  2 


[x1(T)-  x,(T)]2  +  [y1(T)~  y2  (T) ] 2  =  dz. 


imiji 


39 


d.  The  Basic  Equations  In  the  Relative  Coordinate  System. 

We  now  transform  the  above  equations  to  the  relative  motion 
coordinate  system  discussed  previously.  In  this  new  system  x  is  the 
distance  the  Evader,  E,  is  from  P  in  a  direction  measured  perpendi¬ 
cular  to  F's  heading.  In  this  relative  coordinate  system  there  are 

two  factors  leading  to  the  apparent  motion  of  E: 

vV' •• 

-,;(1)  rectilinear  motion  of  P  and  E,  and 
'/  ' .  (2)  rotation  of  the  coordinate  system  when  P  turns. 

Th«  components  of  velocity  due  only  to  translation  are  given  by  (see 
Figure  A3) 

r  ^  "  a2  sin 

(jjf)  -  s2  coe  *  ~  8X- 

since  P's  motion  is  always  directed  along  the  y-axis.  We  next  derive 

the  components  of  velocity  due  only  to  rotation  with  angular  velocity 
d0 

u  m  r-.  When  P  turns  to  his  right  (<t>  ■  1),  E  is  rotated  counter- 
at 

clockwise  about  P.  We  take  w  to  be  positive  when  counterclockwise. 
Then 


-  -wy  -  -(~|)y  »  -s^/R, 

r 

-  ©x "  six<t,/R- 

r 

Using  the  fact  that 


equations  (1)  of  the  main  text  are  readily  obtained. 
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APPENDIX  B.  DESTROYER  TO  FIXED  DESTINATION 

In  this  appendix  we  derive  parts  of  the  solution  for  the  best  way  to 
steer  a  vehicle  with  a  minimum  turning  radius  to  a  fixed  destination  in 
least  time.  We  call  this  problem  "destroyer  to  fixed  destination."  It 
is  of  special  significance,  since  it  is  the  limiting  case  of  the  homicidal 
chauffeur  game  when  the  Evader's  speed  goes  to  zero.  Study  of  this  problem 
has  increased  our  insight  into  these  pursuit-evasion  problems.  The  new 
geometrical  construction  for  optimal  paths  was  first  suggested  in  our 
study  of  this  problem.  As  a  general  principle,  many  times  most  of  the 
significant  solution  aspects  of  a  differential  game  may  be  studied  by  con¬ 
sidering  a  one-sided  version  of  the  problem. 

We  state  the  problem  and  then  present  the  details  of  analysis.  Next, 
we  discuss  our  new  geometrical  construction  for  optimal  trajectories  in 
such  problems.  Finally,  we  discuss  the  geometry  of  the  solution  and 
summarize  the  analysis  results.  Many  solution  steps  and  aspects  are  ex¬ 
plained  in  elaborate  detail  in  this  appendix. 

a.  Statement  of  the  Problem. 

The  problem  is  to  determine  how  to  steer  a  constant  speed  vehicle 
with  minimum  turning  radius,  R  ,  from  any  point,  (x^,y^)  ,  in  the  plane 
to  within  a  distance,  i  ,  of  a  terminal  point,  »  in  t*ie  least  time. 

In  a  stationary  coordinate  system  the  problem  is 

T 

min 


o 


dt  with  T  unspecified. 
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subject  to: 


dx 

dt 

d£ 

dt 

dtl 

dt' 


w  cos  e  , 


w  sin  6  , 


”  <f>w/R  where  -1  <  4>  <  1  , 


with  initial  conditions 

x(t  ■  0)  -  xL  ,  y (t  -  0)  -  y1  ,  6(t  —  0)  -  6^  , 

and  terminal  condition 

[x(t  -  T)  -  x2]2  +  [y(t  -  T)  -  y2]2  -  i2 

We  transform  this  problem  to  the  relative  coordinate  system  of  Appendix 
Ji  in  the  same  fashion  as  shown  there  to  obtain: 
fT 


subject  to: 


min 


dx 


dt  with  T  unspecified  , 


dt  "  ”R  ’ 


dZ 

dt 


x$  -  w  where  -1  <_  $  <_  1  , 


(Bl) 


with  initial  conditions 


x (t  -  0)  -  xQ  ,  y(t  -  0)  -  yQ 


and  terminal  condition 


x2 (I)  +  y2(1)  -  l2 


TrTf 


fc .  Development  of  Solution 
Hamiltonian,  H(t,  x,  p,  4) 


H(c,  x,  p,  {)  -  1  +  y>t>)  +  P2(‘^  ~w)  . 


where 


SJ*  , 

DjT  and  p2 


— : —  are  dual  variables  and  J* 

jy 


<B2) 

fT 

min  j  dt  . 

4>  ‘  o 


We  determine  the  extremal  control  from 

min  H(t ,  x,  p,  $)  -*  min{|  •f(p2x  -  p1y)  subject  to  -1  £  <f>  £  1. 

Hence 


i  *>  sgn(p1y  -  p^x)  -  sgn  A(t)  , 

f+1  for  x  >  0 

where  A(t)  *  p  y  -  p?x  and  sgn  x  **  j 

, -1  for  x  <-  0 

\ 


(B3) 


Boundary  Conditions  for  Dual  Variables 

Since  termination  is  any  point  on  a  curve,  we  must  have  p  ■  ^pip2^ 
normal  to  this  curve  at  t  »  T(terminal  surface)  (see  [2]  p.  290).  We 
let  n  be  unit  normal  to  circle  (terminal  surface)  pointing  into  the 

•*  -e  ■+  •> 

state  space.  Then  n  m  sin  sit  cos  s  j  ,  and  we  have  p  “  an  .  Since 

the  constant  is  arbitrary,  we  let  it  be  1  and  hence 

p^(t  ■  T)  «  sin  s  ,  p2(t  *  T)  ■  cos  s  .  (B4) 

Usable  Part  of  Terminal  Surface 

Because  of  the  nature  of  the  relative  coordinate  system,  it  is  not 

possible  for  paths  from  the  state  space  to  end  anywhere  on  the  terminal 
2  2  2 

surface  x  (T)  +  y  (T)  *  i  .  Physically,  the  terminal  surface  is  a  circle 
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about  a  moving  point.  In  a  fixed  coordinate  system  this  circle  moves 
with  the  point.  Consider  a  line  perpendicular  to  the  point's  velocity 
vector  and  passing  through  the  point.  This  line  divides  the  circle  into 
two  parts:  one  part  is  ahead  of  the  point's  motion  and  the  other  is  be¬ 
hind.  The  problem  ends  when  a  fixed  point,  the  destination,  crosses  the 
moving  circle.  Clearly,  forward  motion  of  the  point  can  never  cause  a 

fixed  point  to  cross  the  rear  half  of  the  circle.  In  the  relative  coordi- 

-¥■  • 

nate  system,  we  can  describe  this  condition  mathematically  as  n  •  X  0  , 

— ► 

where  n  is  unit  vector  normal  to  the  terminal  surface  and  pointing  into 
the  state  space  and 

,  dx_ ' 

-*•  dt 

X  - 

d£ 

'■  dt 

is  the  vector  of  velocity  components  in  the  relative  coordinate  system  of 
the  moving  point  (destroyer).  That  part  of  the  terminal  surface  for  which 
"capture"  can  occur  is  called  the  uswhle  part,  (see  p.  83  of  [30]). 

For  the  problem  at  hand  we  have 

n  -  sin  s  I  +  cos  s  j  , 

X  *»  (-•£  y<|>)f  +  x<t>  -  w)j  , 

where  the  terminal  surface  is  parametrically  represented  by  s  as  shown 
below. 
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k 

v 


lionet',  we  have 


Then 


x (t  =  T) i  =  £.  sin  s  and  y(t  =  T)  =  &  cos  s. 

-►  . 

X(t  -  T)  =  (-  ~  $  i  cos  s)i  +  (tr  £  sin  s  -  w)j  , 

R  R 


and  hence 


e*r 


n  •  X(t  *  T)  =  (-  f  $  £■  cos  s) sin  s  +  (^  ■(>  i  sin  s  -  w)cos  s 
R  R 


n  •  X  ( t  *.T)  =  -v  cos  s  ^  0  , 


(B5) 


defines  the  usable  part  of  the  terminal  surface.  Thus  cos  s  0  for 
capture  to  occur  and  the  useable  part,  UF  ,  is  given  parametrically  by 


,  ,  x  », 

UP  =  { st  |  -  y  1  s  1  J> 


(B6) 


Equation  (36)  simply  says  that  "capture"  only  occurs  in  the  "front  half" 

of  the  circle  about  the  moving  point. 

The  boundary  of  the  use&le  part  of  the  terminal  surface,  BUP,  divides 
the  terminal  surface  into  useable  and  non-use±le  portions  (see  p.  83  [30]). 
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The  paths  which  terminate  at  the  BUP  are  then  the  barrier,  for  they 
separate  the  state  space  into  regions  from  which  paths  either  do  or  do 
not  "lead  directly"  to  the  UP.  We  have  noted  in  the  main  text  that  Isaacs' 
concept  of  the  barrier  corresponds  to  that  of  the  boundary  of  the  domain  ol 
controllability  in  the  control  theory  literature  ([23]).  We  now  see  that 
we  can  determine  the  barrier  by  projecting  the  BUP  backwards  in  time  before 
capture. 

The  Adjoint  Equations  and  Their  Solution 
We  have  that 

dpl  3H  w 

dt  5x  “P2  R  *  ’ 


3H 

ay 


*  p. 


Since  the  boundary  conditions  for  the  dual  variables  are  given  for  t  =  T  , 
it  is  convenient  to  let  t  ■  T  -  t  and  integrate  the  adjoint  system  back¬ 
wards  from  the  end.  Accordingly,  we  obtain  <  ■ 


ipi. 

di 


p^(i  =  0)  =  sin  s  , 


p2(i  =  0)  =  cos  s 


We  may  combine  these  equations  as  follows: 


d2P: 


di 


^2 

dt 


,w<*> ,  2 

-Pl<T)  or 


d2p 


di 


1  wW(K 

2  +  (T}  P1 


0 
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He  iv  e 


,  \  ,  w-; 

V°  =  A  cos  -- 


+  B  s  i  u  p-  s 


with  initial  conditions 


I'j  ( i  ■  0)  «  /.  =  sin  s 


dp 


-  (t  “  0)  »  ^  iB  »  p2(i  =  0)  «■  ^  <J>  cos  s  -*■  B  *  cos  s 


Substituting  for  the  constants  and  simplifying  we  find 


Pp  ( i )  *  sin (s  +■-<{.  i  )  . 


(B7) 


Similarly,  it  may  be  .-.('own  that 


p,(i)  =  cos  ( fe  b  is  ) 

<£>  J\ 


(B8) 


Solution  to  the  State  Equations 

In  the  "backwards  time"  v«e  have 


dx 

di 


w 

—  J>V 
R  ^ 


y.  (  ■  =0)  =  H  sin  s  , 


dv  w  j 

-  =  -  -•  vx  +  w 


y>  ( i  ---  •')  «*  ,tcos  s 


We  combine  these  equations  to  determine  a  second  order  equation  for  x 

V  •  •  S  .  , 

as  follows  •'  ,  ’  > 


d2x 

diZ 


w  ,  dv  ,v.  ..2  w 

I*  aT  “  "4  *>  x  +  r  *v  • 


d2x 

d,2 


,w  .2 

R  40  * 


The  solution  to  the  above  equation  is  given  by 


x  (i )  »A  cos 


W  L 

R  ^ 


+  B 


.  w 

sin- 


)T  1 


R 

<f> 


where  the  constants,  A  and  B,  are  determined  by 

K  H 

x(t=0)  •  I  sin  s  =  A  +  -  A  =  i  sin  s  -  - 

< t '  .  <#> 

(t  =  0)  =  —  ij)  y(x  =  0)  =  4>  i  cos  s  =  ^  <fB  -►  B  ■  2.  cos  s  . 

QT  K  K  -  K  ' 

'  ! . . 

Hence,  after  some  simplification,  we  obtain: 

x(t)  =  i  sin(s  +  ^  <J>t)  +  ^  (1  -  cos  ^  <fn  )  .  (B9) 

Similarly,  it  may  be  shown  that 

1 1  f 

y(i)  =  l  cos (s  +  |  $t)  +  ^  sin  ^  6- .  (BIO) 

Note  that  the  above  equations  (and  also  (B7)  and  (B8)  hold  from  the  terminal 
surface  (i  *  0)  until  a  transition  surface  is  reached. 

Transition  Surfaces  and  Termination  of  the  Barrier . 

We  have  seen  (equation  (B3)J  how  the  "steering11  variable  <p  (this 
variable  determines  the  rate  of  change  of  heading  for  the  moving  point  in 
the  fixed  coordinate  system)  is  determined  by 

<P  =  sgn  A(t)  ,  (B3) 

where  A(t)  =  p^y  -  P2X  .  There  is  a  problem,  however,  at  t  *  T  ,  since 
A(t  =  T)  =  A(x  =  0)  =  sin  s(Z  cos  s)  -  cos  s(SL  sin  s)  =  0  .  We  can  overcome 
this  by  a  continuity  (with  respect  to  1)  argument.  Moreover,  we  have 
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a  a  ■  i 

a:  V  +  1 


a%* 

^h2 

dx 

j  jf! 

~<F  ‘ 

'  p2  d. 

•  »*,<-* 

,  X  ■+ 

w)  -  (-p 

Hear  o . 

J  * 

-  p2w  =  w  sin('  +-  —  s  i )  wit'-  A ( i  «  0)  =  0  , 

and  then  we  finally  obtain 

.  /  \  }\  *  .  ^  . 

A(i)  =  (cos  b  -  .cos  (s  4  -*  •;  ; )  }  . 
v  K 

Ihua,  tor  0  _  t  _  t  ^  (where  i  ^  will  be  determined  presently), 
<(i)  = 


-1  for  -  2  •_  s  ■-  0 


(Bll) 


+1  for  0  -  s  -  ~ 

—  ^ 

Since  optimal,  trajectories  are  symmetric  about  the  y-axis,  we  only  consider 
solution  behavior  in  the  right  half-plane  of  our  relative  coordinate  system 
Consequently,  for  0  -  s  -  ,  we  determine  t  as  follows :  it  is  the 

■first  time  thal  A(t)  =  0  after  t  ~  0  .  This  happens  when 

'  .  .  cos  s  *  cos  (s  +  “  )  , 

which  is  precisely  when 


2.  w 

71  -  S  =  S  *4  -7  I  . 

J\  A. 


Hence,  for  0  s  ■-  v.j2  ,  we  have 


2R 


1  i  =  V  • 


(B12) 


Equation  (B12)  determines  such  that  4(1)  =  1  for  0  <•_  1  r  .  For 

-  N  t ^  ,  wc  have  A ( t )  ■  0  (we  have  not  proved  this)  and  hence  4 (i )  =  -1 


on  optimal  trajectories  in  some  interval  past  .  Hence,  the  locus  of 
such  points  where  (B12)  holds  defines  a  transition  surface. 

For  s  =  tt/2  ,  we  have  the  harrier  and  hence  4.(1)  =*  1  on  this  "right 
barrier"  for  0  i  Rtt/w  .  From  (H9)  and  (BIO)  ,  the  equations  of  the 
barrier  are 

K  =  -(R  -  £)  cos  |  t  , 

.  ;■  y  ( t )  =  (R  -  i)  sin  ~  i  ,  •/.■■■ 

,  which  we  may  write  as  ■ 

■  '  r.  "  I:v(;)  -*  .  ‘  co‘l'  ;ctol\  ' 

1  ' '  \\  y(x)  /  .••\~sin  r  t  ,:-cos  ~  -t  /  0 

,  '■  ,  ,  K  i  j  ;-J  ■  '  .  -n  v  ,  -  :  . 

■  ;  l*  ‘  t‘  ■  •  m  ■ 

tnat  R 

This  equation  savsfto  determine  a  point  oi  the  barrier  at  time  t  <  —  it  , 

i we  rotate  the  point  x  =  i  -  R  ,  y  =,  0  through  an  angle  jj-  t  in  the 

negative  (counter -clockwise)  sense  about  the  point,  x  •*  R  ,  y  *  0  .  Hence, 

|  r 

for  .0  <_  t  £  ~  x  ,  the  barrier  traces  out  the  curve  .shonv.  below  iri  Figure  B1 


\ 


Figure  Bl.  Farriers  to  Dertroyer  to  Fixed  Destination  Problem. 


N.  w  m'  .Vu.i  I  i  explain  wiiy  riiis  barrier  must,  terminate  at  -  n2/w. 

l\i  haw  p  i rv  i  ous  I  y  discussed  this  subject  in  section  Illb  if  the  main  text 
(.see  .line  pp .  2  i  0- 2  i  *  oi  [30]).  To  summarize,  there  are  two  equivalent 
iiileri.i  mi  termination  ol  the  barrier: 

(1)  (Isaac:;)  due  to  a  change  in  the  orientation  (direction  of  travel) 
ot  the  barrier  cur  ’e  this  semipermeabl e  surface  cannot  be 
extended , 

(2)  (Taylor)  the  barrier  terminates  if  its  extension  would  lead  to  a 
"nml i i covering"  of  extremals  in  the  region  of  extension  (with 
the  extension  being  uon-optimal) . 

For  the  problem  at  hand,  for  i  t  ^  =  itR/w  and  s  =  tt/2  there  would  be 
a  cusp  (tangent  to  curve  continuous  but  both  dx/dt  and  dy/dt  change 
sign),  since  the  extension  (we  have  not  proved  this)  would  be  an  arc  of  a 
circle  with  center  (— K ,  0)  with  |  =  -1  ,  i.e.,  curve  "changes  orientation 
and  there  can  oe  no  semipermeable  continuation"  ([30]  p.  211).  We  recall 

f 

that  for  x  -  x(i)  and  y  =  y(i) 

dy  d  i 

dx  dx 

dt 

Thus  wc  can  have  the  tangent,  dy/dx  ,  continuous  but  both  dx/dy  and 
dy/dt  change  sign.  The  curve,  has  a  cusp  at  such  a  point.  For  the  problem 
at  hand,  the  continuation  of  the  barrier  past  would  produce  such  a 

cusp,  but  a  cusp  is  not  necessary  for  termination  (see  homicidal  chauffeur 


g i me  Appendix  C) - 


We  might  also  argue  along  the  lines  of  (2)  above  that  if  (in  the 
game  of  degree)  the  barrier  wore  to  bo  extended,  it  would  intersect  ad¬ 
jacent  extremals  causing  a  "mui t i-val uod"  solution.  Hence,  we  discard  the 
dashed  portion  shown  in  figure  hi. 

Continuation  of  Solution  Pas'  '1  ransit  ion  Hurl  nee 

Continuation  past  =  2l;/w("  -  s)  tor  0  _  s  -  ’< / 2  ,  results  in 

an  arc  of  a  circle  with  center  (~K,0)  with  travel  for  increasing  i  in 
positive  (counter-clockwise)  direction,  i.e.,  .  =  -]  .  Time  has  not 

allowed  all  such  analysis  details  to  be  worked  out  . 

The  Singular  Solution  (Universal  Surface) 

Fcr  the  problem  at  hand,  the  Hamiltonian  is  a  linear  function  of 
the  control  variable  1  , 

H(t,x,p,v)  =  4  ^  (P2X  “  ppO  +  0  -  P2W)  (B14) 

with  the  control  being  determined  by  (B 3 )  except  for  when  the  coefficient 
of  <t>  vanishes  for  a  finite  interval  of  time.  In  this  case  we  have  a 
singular  solution  [32],  [33]  for  which  the  necessary  condition  of  maximizing 
the  Hamiltonian  (with  respect  to  the  control  variable  C  )  does  not  provide 
us  with  a  well-defined  expression  for  the  extremal  control.  Isaacs 
([30]  Chapter  7)  uses  the  terminology  universal  surface. 

A  singular  extremal  is  determined  from  the  conditions  [32],  [33] 

3H  r  ,  d  3H  ,,  d2  dll  n  ' 

•t—  =  0  and  —■  — -  =  0  .  — r  r —  -  0  ,  etc.  ns  needed 

09  dt  oi}  2 


52 


I- ill'  the  pi.jbli.-ni  ,u  hand  we  also  have.  ll(t,x,p,i)  "  0  ,  since  the  termination 
time  is  imspe.'  1  i  ie.l .  Also,  above  equation  (Bll)  we  saw  that  dA/d:  “  p^w  . 
Thus,  since  511/51  =  -  |v  A  ( i )  ,  we  have  the  following  equations  for  a 
singula:  subarc 


1  -  i'2w  =  0  . 

^(p2x  -  Pjy)  *  o  . 

and  Pj  w*7R  =  0  . 

Hence,  we  see  that  on  a  singular  subarc  we  have 


p.,(t)  =  1/w  >  0  , 


P^O  =  0 
x(t)  -  0  . 


(B15) 


The  singular  control  is  determined  by  the  above  conditions  that  the  dual 
variables  are  constant  Lor  a  finite  interval  of  time.  Recalling  that 
dp^/dt  =  ->p0w/R  and  dp,,/ dt  -  ^p^w/R  ,  we  see  that  4> ( t )  =0  is  the 
required  singular  control.  A  physical  interpretation  is  enlightening: 
once  the  destination  is  straight  ahead  (x(t)  =  0)  ,  the  destroyer  steers 
a  straight  course  (y(t)  =0)  . 

We  must  further  test  to  see  if  this  singular  solution  can  yield  the 
optimal  return;  i.e.,  minimum  time.  l.  necessary  condition  for  a  singular 
subarc  to  yield  the  minimum  return  [34]  is  (see  also  [30]  pp .  187-188) 
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We  have  already  shown  that  <l/dt  OH/9i|>)  *  p^w  /R  .  lienee 


Oji 

K 


w~/ K 


O 

-4p^w(w/R) ‘ 


Thus 


-1' 


-,W  (w/  1\)  *’ 


(B16) 


But  on  the  singular  subarc  (R15)  must  hold,  so  p,,  (t)  -  1/w.  Hence,  on 
the  singular  surlace 


O 


=  -(w/R)2  -  0  , 


and  the  necessary  condition  is  met. 

c.  The  New  Geometrical  Construction  for  Optimal  Trajectories. 

The  following  is  given  to  show  our  original  motivation  in  developing 
this  geometric  interpretation  of  the  solution  to  the  sLate  equations. 

Others  may  prefer  the  analytic  geometry  of  transformations  of  ordered 
pairs,  but  we  usually  remember  such  things  by  considering  complex  numbers. 

We  start  by  recalling  (fll]  p.8)  the  well— known  geometric  interpretation 
of  complex  numbers  in  which  a  complex  number  is  represented  by  a  point  in 
the  plane.  With  this  interpretation,  we  may  Lhen  develop  that  multiplication 
by  a  complex  number  of  unit  modulus  corresponding  to  a  rotation.  We  now  look 
for  an  algebraic  representation.  It  is  well-known  that  the  field  of  com¬ 
plex  numbers  is  isomorphic  to  a  field  of  2x2  matrices  with  the  correspon¬ 
dence  being  given  by 

a  -b 

a  +  ib  -*• 


Ihil  i  .  Wr  Sff  tli.il  l  IK  1*1  J  i :  l\  t  i  Oil 


(giving  tin-  locus  ot  tin'  transition  surface, 


see  above) 


x(  V  -  ' 


sin  -s 


i  sin  s  -  R 


cos  2s.  \  C  nos  s 


O'l  7 ) 


is  i-qn i v.i  1  i-nt  to  (.sec  pp  •  2-5  in  [11  ]) 


(.\(.  )  -  K)  +  i  y  (  .  ^ )  -  i-  [(.'sin  s  -  10  +  it  oos  s]  , 


,nu!  thus  uf.n'.Mi-.ts  a  r.  l.-.wion  oi  the  point  x  =  .is in  s  ,  y  =  (cos  s. 
t !  i  ■  i  ^  1 1  an  any,  1  e  2s  in  the  positive  sense  (counter-clockwise)  about  Lhe 
point  x  ~  K  ,  y  =  0  .  At  ter  we  recognieo  this,  we  may,  ol  course,  use 
analytic  geometry  to  reach  the  same  conclusion- 

Tims,  we  consider  optimal  trajectories  in  the  right  half -plane  for 


0 


2H(-i  -  s)/w.  We  may  write  equation  (B9)  as 


x  ( )  -  K  -  ( .'  sin  s  -  R)  cos  j“  >  +  7  cos  s  sin  ^  t  .  (B18) 


Siiilarlv.  equation  (H10)  becomes 


; o s  ^  co&  t 
K 


-  ( «  ^iu  ^  -  K)  sill 


<k'l9) 


We  mav  write  the  above  as 


tor  0  •-  s  •  r,J 2  and 


0  j  t  y  ; j  =  2R/w(t  -  s) 


••■(O  -  R 


y(-) 


W 

;os  —  t 


\-sm  -  x 


sin  l  x 


VJ 

COS  77  1 
K 


x(T)  -  R 

1 

i 

V  y(T) 


(B20) 


whe  re 


x(T;  =  i  sin  s  ,  y(T)  =  2  cos  s. 


The  geometric  interpretation  of  (B20)  is  that  the  point  x(i)  ,  y  (l) 


which  lies  on  a  trajectory  terminating,  at  x  (T) ,  y('l')  may  be  obtained  by 
rotating  the  point  x(T)  ,  v(T)  through  an  angle  w;/K  in  the  negative 
sense  about  the  point  x  =  K  ,  y  =  0  .  We  recognize  the  example  above 
(Bi7)  as  the  special  ease  of  (B20)  when  i  *=  i  =  2K(n  -  sj/w. 

Let  us  see  how  the  above  geometric  interpretation  is  useful  in 
sketching  the  transition  surface.  From  (B12)  we  see  that  .1  change  in 
steering  occurs  at  different  times  for  different  trajectories.  We  have 

s -  0  i  1 1 =  2,1 

n/4  3/2' 

•n  /  2  r. 

By  considering  the  geometric  interpretation  of  (B20),  we  obtain  the 
picture  shown  below  in  which  the  transition  surface  is  a  uashed  line. 


d  .  (Jeomoliv  ol  Lho  Sol  UL  ion 


lu  this  section  wo  summarise  Lho  results  of  analysis  by  drawing  a 
picture  of  t  ho  opt imal  t  raj  color  ios  with  the  control,  ,  being  indicated 
in  various  regions.  The  singular  subarc,  x  =  0  ,  and  paths  leading  to 
ii  (wo  hove  not  done  this  analysis)  are  also  given.  This  is  shown  in 
Figure  lit.  Again,  the  reason  this  "one-sided"  problem  has  been 

studied  in  such  detail  is  that  it  is  the  limiting  case  of  the  homicidal 
chauffeur  game  when  the  llvjder  is  immobile,  i.e.,  =  0  . 


\ 


< 


V 


t'=+l 


T^Barri  er 

r  • 
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N 


Figure  B2.  Optimal  Trajectories  for  Destroyer  to  Fixed  Destination 
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We  should  note  that  the  above  solution  is  in  the  relative  coordinate 
system.  We  discuss  briefly  how  the  optimal  paths  look  in  a  fixed  coordi¬ 
nate  system.  Such  is  shown  beloWjWhere  the  point  p  is  the  movable  point 
and  three  destinations, 


B 


A,  B,  and  C  are  shown.  These  points  correspond  to  A,  E,  and  C  of 
Figure  B2.  Point  A  is  reached  by  turning  as  sharply  as  possible,  <J>  «=  1. 
Point  B  is  reached  by  turning  sharply  and  then  a  straight-on  approach. 

The  last  part  is  the  singular  subarc  where  <J>  =  0  .  Point  C  is  within 
the  minimum  turning  radius,  R,  and  some  maneuvering  is  required  by  P  . 
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AIT  KM)  IX  C 

ORIGINAL  HOMICIDAL  CHAUFFEUR  GAME 

In  this  appendix  u\>  del ive  parts  of  Llio  solution  to  Isaacs1  homicidal 
chauffeur  game  [30].  Wo  do  so  because  of  iLs  close  similarity  to  the  sur- 
vei  1  lance-evasion  game  (see  section  111  ol  main  text). 

We  state  the  problem  and  present  details  of  its  solution.  Next,  we 
discuss  our  new  geometrical  construction  for  optimal  trajectories  in  this 
problem.  Finally,  we  discuss  the  geometry  of  the  solution  and  summarize 
the  analysis  results.  A  more  detailed  discussion  of  many  solution  steps 
is  to  be  found  in  Appendix  B. 

a .  Statement  of  the  Problem . 

Ttie  problem  is  to  determine  how  a  Pursuer,  who  travels  at  a  constant 
speed  w  ,  with  c  minimum  turning  radius  R  ,  should  steer  to  capture 
in  minimum  time  T  an  Evader,  who  travels  at  constant  speed  ,  has  no 

restriction  on  maneuverability,  and  tries  to  maximize  the  capture  time  T. 
Capture  conditions  are  defined  by  Pursuer  and  Evader  being  separated  by  a 
distance  i  .  In  a  stationary  coordinate  system  the  problem  is 

T 

min  max  dt  with  X  unspecified  , 

9  P  *  0 

subject  to:  dx^/dt  =  w^  cos  a  , 

dy^/dt  =  w^  sin  a  , 
da/dt  =  I  w^R  where  -1  <_  if  <_  1  , 

dx,/dt  *  w,,  cos  £ 

dy^/dt  *>  v.'2  sin  i  , 


wiili  initial  cond i  t  i  ous 


j9 


Xj  (t-0)  =  Xj  ,  yJ(t  =  0)  =  y1  t  ft(t=0) 

x9(t.^0)  -■=  ,  y -0=0)  =  , 

Z  Z  Z  4. 


and  terminal  conditions 


[xn  (T)  -  x9('l)]2  +  [y1(T)  -  y^(T)]2  =  s} 


We  transform  the  above  problem  to  the  relative  motion  coordinate  system  of 
Appendix  A  in  the  same  fashion  as  shown  there  to  obtain: 


mm  max 
<j>  i'  ‘ 


dt  with  1  unspecified  , 


subject  to:  dx/dt  -  -w^/R  yi  +  sin  y  , 


dy/dt  =  w. /r  x>f;  -  w.  +  w^  cos  if  where  — 1  <  4>  <  1  ,  (Cl) 

i  i  i.  —  —  - 


with  initial  conditions 


x(t=0)  *  xQ  ,  y(t=0)  =  vQ  , 


and  terminal  condition 


2  2  2 
x  (T)  +  y  (!)  =  9 


b.  Development  of  Solution. 


Hamiltonian,  B(t,x,p;  cb ,  tfi ) 


H ( t . x , p ; (f , i(j )  =  1  +  p  (-  —  y  *  +  w2  sin  ^ 


+  P2i  Y  ”  W1  +  w2  cos  ^  ’ 


(C2) 


■VI  MM  Mir 
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whole  p,(t) 

=  Cj J * / . t -x  (t)  and 

=  jJ*/L'v  (0  are  dual 

variables  and 

1 

=  min  max 

fT  I 

!  dt  =  max  min 

rT 

dt  .  Wc  determine  extremal  strategies 

s  V 

■'o  g-  v  J 

'0 

f  rom 

min  max  H(t ,x,p ;4  ,4)  -*■ 

v  V 

W1 

min  {-  —  Hp^  -  P2x)}  , 

and 

max  iw^Cp  sin  4  +  p_  cos  4)1  . 

Hence 

4 

4  «=  sgn  A(t) 

> 

<C3) 

where 

A(t)  «=  p, y  -  p.,x  . 

To  maximize 

X  J. 

with  respect  to  4 

it  suffices  to  consider 

f(4>  =  Pj  sin  4 

+  p.,  cos  4  - 

rfe 

A  necessary  condition  is  that 

df/d^1  “  0  =  Pj  cos  v  _  P2  sin  » 

and  hence 

tan  ij'  -  P1'/P2 


Thus,  to  maximize  we  must  have 


sin  V 


COS  4  = 


/  2  2 
/  Pi  +  P2 


(C4) 


*  Pj_  +  P2 
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Bouudarv  Conditions  for  Dun!  Variables 


~t 

Wc  must  have  p  -  (p  p,,)  parallel  to  the  normal,  n  ,  pointing  Into 
the  state  space  to  the  terminal  snriaee.  Now,  since 


n  =  sin  s  1  +  cos  s  j  ,  we  have 


p,  (t  -  T)  «  sin  s  p  (t  *  T)  =  cos 
J-  w 


Usable  Part  of  Terminal  Surface 


We  have  that 


n  “  sin  s  i  +  cos  s  j  , 

■*  w.  w, 

•  1  4  1  _v 

X  “  ("  —  yi  +  v2  sin  v'Oi  +  (—  x|  "  ^  +  w2  cos  ^)J  » 

where  the  terminal  surface  is  parametrically  represented  hy  s  as  shown 
below.  i 


■»  /  v 

'  \ 


Hence,  we  have 


Hence, 


x(t  =  T)  =  l  sin  s  and  y(t  =  T)  =  £  cos 


n  *  X(t  =  T)  =  ( - pr  $  i  cos  s  +  w2  sin  >Jj)sin  s 


+  <f>  !■  sin  s  -  w:  +  w2  cos  f)i 


6 i 


(CIO) 


t>4 


So  1  n l  i oil _ t  o  t  i  t- _ Slat c _ 1  t a t  ion s 

In  1 1  it-  "backwards  Lime"  wc  have 


v'l  W] 

dx.'d;  »  ■  f  y  -  w.,  si  ills  "*  T  <  1  ) 

K  h 


wi  wi 

dv/di  *=  -  — -fx  +  w  -  cos  ( s  -t  -  j  i  ) 
K  1  2.  h 


x(i  “  0)  “  XL s In  s  , 

y(i  «  0)  «  cos  s  . 


Wo  comb iiio  these  equations  to  determine  a  second  order  differential  equation 
lor  x  as  follows 

2  2  wl  dv  wi  wi 

d  x/dt  R  v  dl  w2  R  *  C0S<‘S  +  'K  ^ 

wi  :  wi  .  wi 

“  ’  “  T  ^  ^w2  '■’0b(:i  +  *j“  s*'0  -  w  } 

W1  W1 

-  wn  — -  <■  cos  (s  +  ~  <M) 

or 

2 

rj  v  ^  w,  w  w 

d\x/di"  +  (--•  <f)"x  =  -2~  f  w2  co  s  ( s  +  —  4- 1 )  +  4>  >  (ell) 


with 

x(i  *=  0)  »■  i  sin  s  , 

W1 

dx/dt(i  =  0)  -  —  4  i  cos  s  -  w.  sin  s 
K  / 

Tiie  general  solution  to  the  above  inhomogeneous  differential  equation  is 
given  by 

x(i)  *  ( i )  +  x  (O  ,  (C12) 


where 
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Similarly, 


dv2  R(t)u1<i) 
dt  w. 

<r  ♦> 


Substituting  (C17)  and  the  definitions  of  u,  and  into  the  above, 

we  find  that 


dv^  w^  Wj 

=  w„  sin(s  +  2  —  <j>-r)  -  w„  sin  s  -  w,  sin  — -  4>i  , 

di  l  K  L  1  K 


wi  wi 

-w„  cos  s  -  w.  cos(s  +  2  —  4>t)  +  w  cos  —  $i 
/  /  K  IK 


Integration  of  these  equations  yields 


W2R  W1  R  wi 

v1(t)  =  "  cos(s  +  2  T  *t)  "  TW2  sin  s  +  $  cos  T  *T  ’ 


w2R  W1  R  wl 

v2(t)  -  -  xw2  cos  s  -  2^  sin(s  +  2  —  <(>t)  +  -  sin  —  $t. 


Substituting  (C20)  and  (C21)  and  the  definitions  of  u^  and  u^  into 
(C14),  we  obtain  after  some  manipulation 

w  R  w  w 

x  (i)  =  ~  T TT  cos(s  +  -r-  <J>0  -  tw  sin(s  +  ~  $i)  +  ~  (C 

p  2w24>  R  L  R  $ 

Combining  (C13)  and  (C22),  we  see  that  the  general  solution  to  (Cll)  is 
given  by 
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Note  that  the  above  equations  (and  also  (C8),  (C9) ,  and  (CIO))  hold  from 
the  terminal  surface  (t  ■  0)  until  a  transition  surface  is  reached  or 
the  trajectory  terminates. 

Equation  of  the  Barrier 

We  have  seen  (see  Appendix  B)  that  the  barrier  (boundary  of  the  domain 
of  controllability)  is  an  optimal  trajectory  which  terminates  at  the  BUP. 

We  have  seen  in  (C7)  above  that  the  boundary  of  the  use&le  part  (BUP)  is 
given  by  s  =  +  S  ,  where  0  <_  S  <  tt/2  and 


cos  S  =  w2^wi  * 


(C27) 
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Because  of  the  symmetry  about  the  y— axis  in  this  problem  it  suffices  to 
consider  the  right  barrier,  i.e.,  the  one  for  which  s  =  S  .  In  the  next 
section  we  show  that  <J-  (i )  =  1  for  s  =  S  and  0  <  i  i  ^  where  i  ^  is 
also  determined.  Thus,  the  equation  of  the  right  barrier  is  given  by 

for  0  i  <_ 

w  w 

x(i)  =  0-  -  iw2)sin(S  +  •—  t)  +  K (1  -  cos  ~  i  )  ,  (C28) 

and 

w  w 

y  (t )  =  (5.  -  xw2)cos(S  +  -g-  t)  +  R  sin  ~  t  .  (C29) 

It  is  not  obvious  (as  Isaacs  and  others  seem  to  infer)  that  (C28)  and 
(C29)  are  the  equations  for  the  involute  to  a  circle.  It,  therefore, 
seems  appropriate  to  digress  and  review  some  analytic  geometry.  Our  dis¬ 
cussion  follows  R.  Courant  ([12]  pp.  280-283  and  pp.  307-310). 

Consider  a  curve  represented  parametrically  by  x  =  x(t)  ,  y  *  y(t) 
in  the  plane.  The  curvature,  <  ,  of  this  curve  at  a  point  is  given  by 

•  •  t 

k  =  da/ds  ,  where  tan  a  =  y/x  =  (dy/dt)/ (dx/dt)  .  The  radius  of  curvature 
is  defined  by  p  =  1/k  .  For  a  given  point  on  the  curve,  there  is  a 
circle  of  curvature  corresponding  to  the  point.  This  circle  touches  the 
curve  at  the  point  and  there  has  the  same  sense  of  description  and  the  same 
curvature  as  the  curve.  Its  center  is  called  the  center  of  curvature.  Con¬ 
sider  the  diagram  below.  At  any  point  (x,y)  ,  the  center  of  curvature, 
(c,n)  ,  is  given  by 


fn agent 


^  ..  .  . 

(x,y)  1 


t  =  x  -  p  sin  a  , 


n  =  y  +  p  cos  a  , 


where 


Fl  ,  *2 

/x  +  y 


The  locus  of  such  centers  of  curvature  to  a  curve  is  called  the  evolute 
of  the  curve,  C  .  We  further  call  C  the  Involute  of  its  evolute.  The 
evolute  is  the  "envelope"  of  the  normals  to  C  .  An  important  fact  that 


we  shall  use  later  is  that  the.  tangent  to  the  evolute  of  a  curve  is  normal 

•  •  •  * 

to  the  curve,  i.e.,  £  x  +  n  y  =  0 

If  we  have  a  curve  £  =  £(cr)  ,  n  *  n(o)  where  o  is  parameter,  then 
the  equations  of  the  involute  to  this  curve  are  given  by 


x=4+(a-o)C  , 


y  =  n  +  (a  -  o)n 


For  a  circle,  represented  parametrically  by 


fj  =  -cos  t  , 


n  =  sin  t  , 


the  involute  is  given  by 


x  =  -cos  t  -  t  sin  t, 
y  =  sin  t  -  t  cos  t  . 


It  is  worth  noting  that  all  the  normals  to  the  curve  given  by  (C31)  are 
tangent  to  the  circle  (C30) .  We  show  the  curves  below.  Another  geometric 


71 


property  of  Involutes  that  we  shall  use  is  that:  let, 


C 


>1  •«  distance  from  A  to  B  , 

£ ^  -  are  length  from  B  to  D  , 

Jt^  =  distance  from  C  to  D, 

where 

AB  and  CD  are  normals  to  involute. 

Then 

i  +  i2  «  i  (C32) 


To  show  that  (C28)  and  (C29)  are  the  involute  to  a  circle,  we  must 
show  that  they  are  of  the  form  (C31) .  To  do  this  we  consider 

W1  W1 

R  cos  —  x  =  R  cos  (—  t  +  S  -  S) 

K  K 

V  W 

=  R  cos  x  +  S)cos  S  +  R  sin(-^  T  +  S)  sin  S  . 

K  K 

Considering  (C27),  we  see  that 

w.  w  w  7 — ^ - o  W1 

R  cos  — p-  t  =  R  — —  cos(-^-  t  +  S)  +  —  /w/  -  w  “  sin(—  t  +  S)  . 
R  w.  R  w,  1  2  R 


Thus,  (C28)  becomes 

x(t)  -  R  =  -  (R  )cos(-^  t  +  S)  +  {  [Jt  -  v4  2  -  w  2  )  -  (R  -p  )  ~  t} 

K  1  L  IS. 

wi 

•  sin  (—  t  +  S)  .  (C33) 

K 


Similarly , 


v  ( ; )  ■=  (R  — 1 -  )  sin  (  ~  \  4  S)  +{[«.-  v  W  *■  -  V  ]  -  (I! 

Wj  K  1  2 


W„  w. 

2.  •.  x  i 

^  >  T  t} 


cos  (  --  i  +  S)  . 
K 


(C34  ) 


Considering  (C.30)  and  (C31) ,  it  is  clear  that  (C33)  and  (C 34 )  are  the 
equations  of  an  involute  to  a  circle  ot  radius  RCw^/w^)  and  with  center 
x  =  K  ,  y  »  0  .  The  equations  of  this  circle  are 

W  V 

C  -  R  =  -  (R  --  )  cos  (-—  t  +  S)  , 


II 
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To  .isure  that  the  involute  is  unwound  under  all  circumstances,  we 
show  that  the  quantity  in  brackets  above  is  always  negative.  This 
from  elementary  geometry  considerations  in  the  above  figure. 


?  W2  2 
*  +  <R  “  > 

1 


■i 

\C 


or 

R  7  2  2 

f.  -  —  /w  -  w„  ^  0  for  all  values  , 
wx  1  2  * 

Transition  Surfaces 
We  recall  that 

$(0  -  sgn  A(  i ) 


where  A(t)  -  p1y  -  p2x  . 
Recalling  that 


x(x  **  0)  «  £  sin  s 

,  y(i  *  0)  «■  £  cos  s, 

and 

p^r  »  0)  =  sin  s  , 

P2(t  =  0)  =  cos  s  , 

we  see  that 

A(x  = 

0)  =  0 

Also, 


dpl  dy  dp2 

dA/dx  =  y  +  p.  ^ - A 


dx 


dx  7  '  ‘'l  dr  di  x  p2  dT 
into  which  we  substitute  the  state  and  adjoint  equations  to  obtain 

W1 

dA/dx  =  p,w  •=  v  sin(s  +  —  $x)  with  A(t  =  0)  =  0  . 

1  X  l  K 

Integration  of  the  above  yields 


R  1  s 

A(i)  =  --  {cos  s  -  cos(s  +  —  4> t )  )  . 
$  R 


must 

follows 


(C3) 


(C35) 


(C36) 


n 


Thus,  tor  0  ^  t  v  i  ,  (where  will  be  determined  presently), 

-1  ior  -S  s_  s  v  0 

y(0  “  >  (C37) 

"41  lor  O'-s^S, 

where  S  is  determined  by  (C27).  By  the  symmetry  of  the  problem,  we 
concentrate  on  the  right  half-plane.  Consequently,  for  0  <  s  <_  S  ,  we 
determine  i  ^  as  follows:  it  is  the  first  time  that  A(t)  »  0  after 
i  ■  0  .  This  happens  when 

w 

cos  s  ■=  cos(s  +  TX) 

which  is  precisely  when 

w 

1 

2  Ti  -  s  -  s  +  —  T  i  • 

Hence,  for  0  <  s  S  <  tt/2  ,  we  have 

t,  »  — -  (tt  -  s)  .  (C38) 

1  W;L 

Equation  (C38)  determines  x^  such  that  <j>(x)  “  1  for  0  <  t  <  t1  . 

For  i  >  i ^  ,  we  show  later  that  A(x)  <  0  and  hence  4>(t)  =  -1.  If 
trajectories  do  not  terminate  before,  condition  (C38)  holds  then  the  latter 
gives  a  transition  surface. 

For  s  =  S  ,  where  cos  S  *  Wj/w  ’  we  have  t^le  bartier  and  hence 

~f(i)  =  1  on  this  "right  barrier"  for  0  <_  t  2R/w^(tt  -  S)  .  From  (C28) 

and  (C29),  we  may  write  the  equations  of  the  barrier 

W1  .  W1 
x ( t )  -  R  »  (Z  -  xw2)cos  S  sin  —  x  +  { (I  -  xw2)sin  S  -  R}  cos  —  x, 

W  W 

y(r)  =-{(£-  xw2)sin  S  -  R}  sin  —  x  +  (£.  -  zv^cos  S  cos  —  x, 


which  we  may  write  as 


/  ,  V  1 

j  x(i)  -  K  \  cos  —  -  \ 


i  l 

\  y  (t)  J  --sin  —  i 


sin 

cos 


R 

VJ 

K 


1 


1 


(* 

\(« 


TW^'lsin  S  -  R 

;  (C3S) 

IW^  cos  S  I ' 


The  geometric  interpretation  of  (C39)  is  as  follows.  To  determine  a  point 
on  the  barrier  at  time  i  (2r/w^)(tt  -  S)  ,  we  start  at  the  point  x  ■  iain  S, 

y  *  i.cos  S  on  the  terminal  surface  (this  is  the  BUP)  and  move  to  a  point 
which  is  a  distance  iWj  along  the  straight  line  connecting  the  first  point 
to  the  origin  (  and  toward  the  origin).  We  now  rotate  this  latter  point 
through  an  angle  (w^/R)x  in  the  negative  (clockwise)  sense  about  the 
point  x  «  R  ,  y  ■  0  .  Hence  for  0  <_  (w^/R)  i  <_  2tt  -  2S  ,  the  barrier 
traces  out  the  curve  shown  below  in  Figure  Cl. 


Figure  Cl.  Barrier  in  Homicidal  Chauffeur  Game. 
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Coin  I  iiu.  1 1  it'n  o  I  s.'iut  i  on  Past  T  r.ms  i  l  i on  Sut  ace  and  I  mi  1  na  t 1  on  oJL  barrier 

I.alei  wo  show  tli.it  paths  t  o  rmln.it  lug  on  terminal  surface  for  0  s  ^  S 
may  all  comvige  to  tin-  same  point  and  hence  terminate  there  (except  for  the 
bait  let).  The  time  ot  this  eonveyeace  depends  on  the  speed  of  the  Evader, 
vn  .  We  recall  that  in  the  limit  as  v, -0  the  solution  approaches  that 
shown  in  Figure  1>2.  If  w,  is  small  enough,  the  transition  surface  beyond 
the  termination  of  the  harrier  may  be  reached  by  a  trajectory  befoie  the 
trajectory  terminates  bv  reaching  the  "focal  point."  lienee,  we  consider 
extension  of  the  barrier  which  we  know  continues  until  .  Details  for 

other  trajectories  (if  they  exist  long  enough)  are  similar. 

Thus,  wc  consider  the  continuation  of  the  right  harrier  past 
(w^/R)ij  -  2(r  -  S)  .  From  (C8)  and  (C9),  we  have 

Pi(|i>  “  -sin  S  ,  -  cos  S  .  (C40) 

From  (C25)  and  (C-6),  we  obtain 


x(t^)  ■=  (i  -  ijW^X-sin  S)  +  R(1  -  cos  2S), 
y('^)  =  (4  -  t^v5)cos  S  -  R  sin  2S  . 


(C41) 


Later,  we  sliow  that  <HO  -  -1  for  r  >  .  We  assume  this  for  now.  The 

adjoint  equations  for  t  >  i ^  are 


^1 

dt 

"  ~P2 

R 

dp2 

dx 

P1 

R 

P1(t1)  =  -sin  S  , 


P2 (T 1)  =  cos  s  ■ 
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The  solution  to  the  above  equations  is  (lot  i  >  tj  ) 

W1 

n.  (0  «  -sin(R  +  —  (’  ~  i, ))  *  -si n  <■  , 

J  K  1 

w,  . 

p?(0  =  C0!i(S  4  — -  (:  -  i,))  =  -OS  vi’  . 


The  state  equations  for  t  >  *. ^  are 
dx/di  s 


W]  v, 

~R  y  +  W2  sil1^  +  T  ( '  ~  ‘  j  '  > 


w  w 

Uv/di  =■  x  +  w,  --  w0  cost?  4  (i  -■  i  ))  r 

*  l\  J  L  R  i 


(C43) 


with  initial  conditions  given  by  (-41).  A  rather  laborious  computation 
(we  omit  the  details)  yields  the  solution  U>  the  above  as  (for  t  >  x^) 


x(r)  =  -  (.t  -  rw2)sin(S  +  — -  (t  -  a } ) } 

w  w 

+  R{2  sin  (t  -  v1>  -  1  -  cos (2S  +  ~  (x  -  r^)))  , 


and 


v(t) 


(t  iw2)cos  (S  +  (t  -  i1>) 


W  w 

+  R{2  sin  (x  -  T^)  -  sin (2S  +  ~  (i  -  i^))) 


(C44> 


■>T  M 


We  may  write  equations  (€44)  as  (for  \  >  i^) 


W  W  v 

/  x(x)  +  R )  /cos  (x  -  r  )  -sin  — -  (x  -  i  )\  (i  -  i  w.J  (-sinS)+2R-Rcos2S 

|  |-f  K  1  1  ^ 4 


y(r)  /  \3in  —  (x  -  x.)  cqs 


W1  /  I 

CS  —  (t  -  x^/  \(C.  -  xw2)cosS- 


Rsin2S 


(C45) 
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i'i  usi;if;  i.l  .  1  j 


M  )  +  I.. 


ce.s  -s'  in 

h  i 


V 1  \  ^ 

T.  1. :  ~  l  ,  )  \  Ji(;,)+W.,(l-1  .)cop('I-  ~S)  + 
i\  J  \  1  £  i  <1 


\  j  \  W  W  .  ; 

\  v  C ' )  Vsi"  , :  ■  v  -  -  ;  1 7  cos  (i-i.).  \  yf-  )-w  (;-i  )sin(~  -5)  / 

i\  1  r  I  ■  \  I  X  *. 


(C46) 


The  most  important  aspects  of  flu-  geometric  interpretation  of  (C46)  are 
that  rotation  is  in  the  positive  sense  about  the  point  x  *  -R  ,  y  =  0 
ami  the  involute  continues  to  unwind.  That  (t'44)  does  indeed  trace  out 
an  involute  may  be  seen  by  writing  it  in  die  equivalent  form 


W0  w 

x ( > )  +  h  *  R  — -  cos(S  +  -=)-  (;  -  !.)) 

W.  K  i 


V  w  ,, 

+  [{3r/l  -  (w,/w,)2  -  it  +  (R  ~  )(.  y  )]sin(S  +  ~  (T  -  t^)  , 


v(i)  *  [-{  3r/i  -  (v/w^)“  -  i.}  -  (R  )(;  ))cos(S  +  ~  ^  ~  tj_)) 


w0  w. 


+  R  ---  sin  (S  +  (i  -  t,))  , 


w. 

JL 


(C47) 


which  is  an  involute  to  a  circle  of  radius  R^^/w  )  and  with  center 
x  =  -K  ,  y  *  0  .  The  involute  is  unwound  from 

w,  u’i  / - ~2 

(  —•  i )  (R  —  )  =  -3R/1  -  fw  /w  )  +  i.  <  0  . 

K  *  W.  - ^  1 


If  we  were  to  try  to  extend  the  barrier  given  by  (C44)  (or  any  equivalent 
form),  we  would  find  that  the  barrier  "bends  back  on  self"  as  shown  by 
the  dashed  line  In  Figure  Cl.  Hence,  by  the  arguments  given  in  Appendix  B, 
the  barrier  must  terminate  at  ; ^  -  C'R/wj )  (e  -  b) 
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Tin1  Sing ular  Solution  (Universal  Surface) 

Since  the  Hamiltonian  is  a  linear  function  of  the  Pursuer's  control 

variable  ,*  ,  the  maximum  principle  does  not  determine  the  control  when 

the  coefficient  of  i  vanishes  for  a  finite  interval  of  time  (see.  Appendix 

B) .  Part  of  a  trajectory  for  which  this  occurs  is  called  a  singular  subarc. 

The  Hamiltonian  is 
w 

1 

H(t,x,p;i,t0  =  -  (p^x  -  p1y)  +  w^Cp^  sin  ^  +  P2  cc>s  i|>)  +  1  -  p^ 

or  using  (C4),  we  have 

wi  7  ~2  2 

H(t  -  (p2x  -  p^y)  +  w^/p.,  +  p2  +  1  -  p2w  .  (C48) 

We  determine  the  conditions  for  a  singular  subarc  from 

H  =  3H/3ij)  =  (d/dt)  (3H/34-)  =  0  (C49) 

Recalling  that  above  equation  (C36)  we  had  dA/dt  =  -w^p^  and  noting  that 
3H/3<t'  =  (-w^/R) (A(t))  ,  we  have  from  (C49)  the  following  conditions  for 
the  singular  surface 

r 2  2 

w2/p1  +  P2  +  1  -  P2W|  =  0  , 

T  (P2X  -  ply)  =  0  ’ 

2 

w 

1 

pl-R-  -  0  ■ 

and  hence 

P 1  ( t )  =  0  , 

p2(t)  =  >  0  >  (C30) 

1  2 

x(t)  =  0  . 
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The  singular  control  required  to  yield  the  above  is  readily  seen  to  be 


7~ 2 

i(t)  -  0  .  Hence  recalling  (C4),  i.e.,  sin  =  p^(t)//p^-  +  p^’ 


we  see  that  t[' (t)  *=  0  on  the  singular  suharc.  We  have  not  traced  paths 
which  lead  to  x(t)  =  0  backwards  as  Isaacs  has  done  ([30]  pp .  193  -  194). 
The  necessary  condition  for  optimality  [34]  on  the  singular  subarc  is  also 


met  since 

2 

3  t  d  /  3H  . .  ,  ,  2  - 

~  (  — (  ~r  ))  ~  -  (w.  /R)  <  0  . 

dt2  ^  1 

Determination  of  Capture  Criterion 

We  have  discussed  in  section  Illb  of  the  main  text  that  a  very  impor¬ 
tant  question  is  whether  or  not  the  barrier  divides  the  state  space  into 
two  parts.  For  the  problem  at  hand,  if  the  barrier  does  not  divide  the 
state  space  into  two  parts,  then  (it  appears  as  though)  capture  can  occur 
from  any  initial  point,  i.e.,  the  entire  state  space  is  the  capture  zone. 
The  only  way  that  the  barrier  can  divide  the  state  space  into  two  parts  is 
for  the  "left"  and  "right"  barriers  to  meet  in  the  y-axis.  We  now  develop 
the  condition  for  this  to  occur. 

We  consider  Figure  C2  and  recall  the  relationship  between  two  normals 
to  the  involute  of  a  circle  given  by  (C32).  When  capture  can  be  avoided, 
the  barrier  intersects  the  y-axis.  In  Figure  C2,  we  have 

*1  “  *2  +  S  ’  (C51) 

i.e.  the  difference  in  the  length  of  the  normals  is  equal  to  the  distance 
on  the  perimeter  of  the  circle  (evolute)  between  points  of  tangency. 

For  capture  to  always  occur,  i.e.,  barrier  does  not  intersect  or  touch 
y-axis,  we  must  have 


R  >  «.JL  . 


(C52) 


9 
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We  also  have 

sin  S  ■=  £4/R  =  (2  +  2j/R  , 
or 

&2  =  R  sin  S  -  2  ,  (C53) 

and 

A 3  =  R(w2/w1>(  y  -  S)  ,  (C54) 

Now,  since  -  S)  c  A^w  /  (Rw2^  <we  ^ave  (also  using  (C27)) 

sin(A2w^/(Rw2))  =  cos  S  »  w^w^  , 

and  hence 

A3  *  R(w2/w1)  sin  1(w2/w1)  (C55) 

Combining  (C51) ,  (C52) ,  (C53),  and  (C55) ,  we  obtain  the  condition  for  the 
entire  state  space  to  be  the  capture  zone 

A  >  R{/T1^7  +  (w2/w^)  sin  1(w2/w1>  -  1}  (C56) 

c .  The  New  Geometrical  Construction  for  Optimal  Traj ectories ■ 

We  consider  optimal  trajectories  in  the  right  half-plane  for 
0  t  <_  x^  =  2R/w3(ti  -  s)  .  Background  material  is  to  oe  found  in  Appendix 

B.  For  0  <_  t  x^  ,  we  have  that  $(x)  «  1  for  0  <  s  S  ,  and  (C25) 
and  (C.26)  may  be  written  as 

W1  W1 

x(t)  -  R  =  (A  -  xw,)cos  s  sin  —  t  +  { (2  -  xw  )sin  s  -  R)cos  —  x  , 

Z  K  Z  K 

and 

W1  W1 

y(x)  *  -{ (A  -  xw„)sin  s  -  R}sin  ~  x  +  (2  -  xw,)cos  s  cos  —  x  , 

Z  K  Z  R 


(C57) 
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which  we  may  write  as 


for  0  ■■  s 

1  *» 

S  where 

cos  S  *  w2^wi 

and  0 

i 

x(0  -  R1 

[cos  ^  T 

.  W1 
sin  ~  i 

f  \ 

(£.  -  iw2)sin  s  -  R 

\y(0  j 

i -sin  r 

W1  I 

s  T  1  / 

|  (H  -  tw2)cos  s  j 

The  geometric  interpretation  of  (C58)  is  as  follows.  To  determine  a  point 
on  an  optimal  trajectory  at  time  t  minU/wj .  2R/w^(tt  -  s))  (we  presently 
shall  show  why  addition  restriction;  see  above  near  (C39)  for  case  of  barrier), 
we  start  at  the  point  x  “  l  sin  s  ,  y  ”  i  cos  s  where  s  e  UP  and  move 
to  a  second  point  which  is  a  distance  tw^  towards  the  origin  along  the 
straight  line  connecting  the  first  point  to  the  origin.  We  now  rotate  this 
second  point  through  an  angle  (v'^/R)t  in  the  negative  (clockwise)  sense 
about  the  point  x  *  R  ,  y  =  0  . 

We  have  used  the  above  geometric  interpretation  (C58)  to  discover  in 
the  homicidal  chauffeur  game  a  central  field  of  extremals  through  a  point 
on  the  barrier  corresponding  to  t  =  l/w^.  All  "primary  solution"  extremals 
(see  [30]  p.  278)  pass  through  this  same  point.  For  0  <  t  <  Jl/w^  »  we 
suspect  that  on  any  primary  trajectory  there  is  no  point  conjugate  to  t  *  0, 
but  we  cannot  check  this  by  the  Jacobi  condition,  since  the  strengthened 
Legendre-Clebsch  condition  is  not  satisfied,  i.e.,  •  0  (see  [9]  p.  181, 

also  [44]  p.  398).  The  significance  of  a  conjugate  point  is  that  the 
primary  solution  terminates  at  this  locus  of  focal  points  to  the  UP  of  the 
terminal  surface. 


We  can,  however,  investigate  the  existence  of  conjugate  points  by  the 
use  of  our  geometrical  construction  (C58).  Another  way  of  looking  at  the 
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conjugate  point  condition  is  that  P., ,P 2  c  UP  and  P^  f  yield  the  Bame 
point  on  an  extremal  trajectory,  i.e.,  adjacent  extremals  interse.ct.  By 
consideration  of  the  geometric  interpretation  of  (C58)  it  is  clear  that  for 
P^  and  ?2  to  yield  the  same  point  on  an  extremal; 

(1)  they  must  lie  on  the  same  circle  with  center  x  =  R,  y  **  0  , 

(2)  it  must  be  possible  to  obtain  from  P^  by  an  appropriate 

rotation  about  x  =  R,  y  =  0  given  by 

\  ■  wi  w  .  \ 

j (l  -  XjW^sin  s^  -  R  \  !  cos  sin  —  (T2_11^'  (£-x2w2^sin  s2  ~  R 

I  • 

W1  W1  ‘  ' ' 

(i- T.jW2)cos  s1  j  \j-sin  —  (t^^)  cos  —  \  (S'_12w2^COS  s2 


(C59) 

where  t2  -  x^  >  0  causes  a  rotation  in  the  negative  sense.  From  (C59)  it 
is  clearly  sufficient  that  x^  =  x2  =  Jt/w2  .  Also  if  ’p  *  a2  ’  then  it:  is 
necessary  that  x^  *  i./w2  '  This  i-s  easily  seen  by  considering  (C59)  for 
t  -  x2  .  it  reduces  to 


and 


(5,  -  x1w2)sin  -  R  =  (5.  -  x2w2)sin  s2  -  R  , 


(H  -  x}w2)cos  sx  =  u  -  x2w2)cos  s2 


Hence  if  t  s2  ,  we  must  have  riv2  =  x0w2  =  i.  .  Since  this  is  also 
sufficient,  it  suffices  to  consider  x  e  {  t  |  S.  -  xw^  >  0}  .  Although  in 
further  research  we  have  not  been  able  to  prove  or  disprove  intersection  of 
adjacent  extremals  for  x  <_  1/ w2  ,  we  have  shown  the  following: 

(a)  for  and  P2  e  UP  to  yield  the  same  point  on  an  extremal 

for  x^  =  S,/w2  ,  it  is  necessary  that  x^  =  x2  , 
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and  (b)  for  F  j  and  1%  c  U"  and  such  that  ^  j.  '  “j  i  “  Lo  yield 
the  same  point  on  an  cxLremnl,  we  must  have  t  >  . 

To  prove  (a)  wc.  proceed  as  follows.  For  and  P2  to  lie  on  the 

same  circle,  by  (C59)  we  must  have 

2  2 

[({  -  TjWjJsln  -  R]  +  I  (1  -  x  w2)coS  = 

2  2 

[ (2  -  i2w^)sin  s2  -  R]  +  [ (i  -  t2w2)cos  s21  , 

which  yields  the  Hollowing  quadratic,  equation  for  w2  : 

2  2 

™2X2  ~  2,2^W'j  ~  Rw2  sin  s2^  ~  [2R£(sin  s2  -  sin  s^) 

2  2 

-  2t^{w2  -  Rw2  sin  s^l  +  w2  ]  »  0  , 

whose  solution  is  given  by 

W2T2  *  (1  “  R  ^in  s2)i/ (w2t1  "  1  +  Rsin  s2>2  +  2R(sin  s2  -  sin  s^Hi.  -  t^w^). 

Noting  that  when  s^  ■  s2  we  must  have  »  t.,  ,  we  see  that  the  minus 
sign  is  extraneous  and  hence 

7 — “  ‘  ~2 - 

w.t.  =  (1  -  Rsin  s0)  +  /(w..t  -  1  +  Rsin  s„)  +  2R(sin  s0  -  sin  s1 )  (i.  -  t  w  ). 

*.  L  Z  Z  1  Z  *■  i  X  Z 

(c60) 

Assertion  (a)  follows  from  letting  =  S./w2  in  (C60) 

To  prove  (b)  for  Si  -  xv^  >  0  ,  we  note  that  for  0  ^  s2  <  s^  5  n/2 
we  have  sin  s0  *■'  sin  .  Hence  using  (C60)  we  see  that 

w2t2  -  1  +  R  sin  s2  <  w2t^  -  R  +  R  sin  s2 


or 


(C61 ) 
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As  stated  above,  we  suspect  that  adjacent  extremals  do  not  Intersect 
for  i  «•  K. /w^  ,  but  we  luive  not  been  able  to  prove  this.  We  have  shown  that 
all  extremals  which  terminate  on  terminal  surface  for  0  r.  s  <_  S  pass 
through  the  same  point  at  i  «  i/v2  .  Hence,  all  such  trajectories  (except 
the  barrier  s  »  S  )  terminate  at  this  point • 

d.  Geometry  of  the  Solution. 

In  this  section  we  summarize  the  results  of  analysis  by  drawing  a 
picture  of  the  optimal  trajectories  with  the  control,  <f>  ,  being  indicated 
in  various  regions-  The  singular  subarc,  :t  »  0  ,  and  part  of  the  paths 
leading  to  it  (we  have  not  done  this  analysis)  are  also  given-  As  noted  above 
the  entire  state  space  may  or  may  not  be  the  capture  region.  From  (C56) , 
we  let 

1*  -  R{/l  -  (w^w^)2  +  (w^/w^sin  ^w^w^)  -  1}  .  (C62) 

Then  there  are  two  cases  to  consider 

l 

(1)  o,  n*  barrier  meets  negative  y-axis 

(2)  i  >  {,*  entire  state  space  is  capture  zone. 

In  case  (1)  the  Pursuer  can  only  achieve  capture  for  a  small  portion 
of  the  state  space  if  the  Evader  plays  properly.  This  is  shown  in  Figure 

C2,  in  which  only  the  right  barrier  is  shown. 

In  case  (2)  the  entire  state  space  is  the  capture  zone.  Optimal  tra¬ 
jectories  for  this  case  are  shown  in  Figure  3.  There  are  two  further  cases - 
For  1/^2  <  2R(n  -  S)/w^  ,  paths  terminating  on  UP  for  0  <  s  _<  S  all  con¬ 
verge  to  point  A  at  t  “  This  is  the  case  shown  in  Figure  3.  When 

1/ >  2R(tt  -  S)/Wj,  such  trajectories  meet  past  point  B  at  the  end  of  the 

barrier,  and  there  is  a  transition  surface  between  this  point  and  B.  As 
w2  0  ,  the  trajectories  approach  those  shown  in  Figure  B2. 
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APPENDIX  I).  SURVEILLANCE- EVASION  CAME . 


In  tills  appendix  we  derive  parts  ol  the  seiution  to  the  surveil¬ 
lance-evasion  game  given  by  equation  (1)  ol  the  main  text.  First,  we 
present  details  of  its  solution.  Next,  we  discuss  our  new  geometrical 
construction  for  optimal  trajectories  in  this  problem.  Finally,  we 
discuss  aspects  of  the  geometry  cr  the  solution  and  summarize  analysis 
results  not  given  in  the  main  text.  A  more  detailed  discussion  of  many 
solution  steps  is  to  be  found  in  Appendix  B  (or  Appendix  C  if  they 
occur  there). 

a.  Development  of  Solution. 

Hamiltonian,  H(t,x,  p;  <fr  ,<i) 

The  Hamiltonian  for  the  problem  given  by  equation  (1)  ot  the 
main  text  is  given,  by 


*1  S1 

li(t,x,p;ij.,;j>)  -  1  +  p .  (-  —  y0>  i-  s2  sin  tfi)  +  p2(—  x<t>  -  s1  +  s2  cos  ^) , 

A  * 

'  ^  j  ^  j 

where  i,t  (t)  =  —  (t.)  and  p,(t)  -  •  (tf  are  the  dual  variables  and 

±  ox  I.  oy 


J  »  max  min  dt  =  min  max  dt.  We  determine  extremal  strategies 


V*  V*0 


V*  sl’*0 


from 


max  min  H(t,x,p;4>,iJj)  «=? 
« t  .4>  ^2’^ 


and 


max  +  P2X^"p2^’  (d2) 

V* 


min  {s2 (p^  sin  p2  cos  if))}. 


(D3) 


s2  ,il> 


(Dl) 
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It  in  clear  I  ron,  (1)2)  (since  s^(t)  £  0)  that  4  is  given  by 

4  (t  )  =  sgn  A (t )  , 

who  re 

A  ( t )  =  -p^v  +  p2'x  (D4) 

The  determination  of  is  more  complicated,  and  we  have  to  use 

results  to  be  established  later  in  this  appendix.  We  parametrically 
represent  the  terminal  surface  by  u  as  shown  in  Figure  D1  below. 


Figure  Dl.  Terminal  Surface  for  Surveillance-evasion  Game. 
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Lacer  we  will  show  that  (where  x  =  T  -  t) 


R  J  l 

A(t)  =  T  {cos  u  -  cos(u  +  —  ((it)}. 


and 


P2(t)  *  -oos(u  +  R~  <p  i  )  ■ 


(D  5) 


<D6) 


Substituting  the  above  into  (02),  we  obtain 


max  (s]_[r  A(t)  ~  P2(T)]} 

s;.  ,4> 

=  maxfs^  cos  u} , 


(D7) 


and  thus  we  see  that  (where  u  refers  to  termination  conditions) 


,  IT  TT 

CW1  for  "  2  "  u  "  2 


sx(t)  =  i 


I  .  r  IT  3 

b  0  for  2  <  U  <  2  11 


(08) 


Next,  we  consider  (D3).  To  minimize  with  respect  to  i p  it 
suffices  to  consider 

f  (ip )  =  p.  sin  ip  +  p7  cos  ip 


A  necessary  condition  is  that 
df 

and  hence 


d* 


0  =  cos  ip  -  p2  sin  ip, 


tan  ip  =  P2/P2‘ 


Thus,  to  minimize  f(ip)  we  must  nave 


-Pi 


-P- 


sin  ip  = 


+  P^ 


cos  ip  = 


*Tm?i 


(09) 
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with  the  minimum  value  being 

min  l  (t)  =  -•'p'  +  <  0  , 

which  implies  that  (D3)  is  given  by 

min  { s 0  f  (il- ) }  =  min  {  - s 2 , 
s2,iJj  *  s2 
and,  hence,  we  see  that 


s2(t)  =  w2.  (DIO) 

Boundary  Conditions  for  Dual  Variables 

We  must  have  pit  =  T)  =  (p^(T)  p^d))  parallel  to  the  normal, 
n,  pointing  into  the  state  space  to  the  terminal  surface  (see  Figure 
Dl).  Now,  since  n  «=  -sin  u  t  -  cos  u  we  have 

p^(t  *  T)  =  -sin  u,  p2(t  ■  T)  =  -cos  u.  (Dll) 

Useable  Part  of  Terminal  Surface 
We  have  that 

-+  -t-  -f 

n  =  -s  in  u  i  -  co  s  u  j , 

t  si  -t  S1  •* 

X  =  (-—  y<(>  +  s2  sin  il)i  +  (-—  x<}>  -  s.^  +  s2  cos  <|>)j  , 

where  the  terminal  surface  is  parametrically  represented  by  u  as 
shown  in  Figure  Dl  above.  Hence,  we  have 

x(t  =  T)  =  d  sin  u  and  y(t  =  T)  =  d  cos  u. 


Hence , 
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•  1 

n  •  X(t  =  T)  =  (-  —  <pd  cos  u  +■  S0  sill  if;)  (-sin  u) 

K  £. 

+  (—  (fid  sin  u  -  s  +  s  cos  if;)  (-cos  u)  , 

R  1  Z 

and  when  we  recall  (see  (D9))  that 

-p1(t-T) 

sin  i|»(t  =  T)  = - — -  -  sin  u  , 

-p2(t=T) 

cos  if»(t  *=  T)  = - ■  cos  u  , 

-► 

— ►  • 

we  obtain  from  n  •  X(t  =  T)  £  0  that 

-► 

n  •  X(t  =  T)  =  - s ^  +  s^  cos  u  £  0.  (D12) 

Recalling  (D8)  and  (DIO),  we  see  that  for  y  <  u  <  -|  n  (D12)  is 
identically  satisfied.  For  -  ^  <  u  <  ^  ,  we  have 

-w^  +  w^  cos  u  £  0, 

where  we  also  assume  w2  <  w^  (otherwise  the  Evader  can  always  escape 
merely  by  "outrunning"  his  pursuer).  Hence,  the  useable  part  of  the 
terminal  surface  is  given  by 

UP  =  tu|u  £  u  £  2m  -  U  where  cos  U  ■  w^/w^,  0  £  1*  £  m/2).  (D13) 

We  note  that  this  is  the  complement  of  the  UP  in  the  homicidal 
chauffer  game  (see  (C7)  in  Appendix  C). 
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Tlif  Ad  jo  hi  t  Equations  and  Their  Solution 
We  have  that 


dpl 

_  3H 

dt 

3x 

dp2 

_  3H 

dt 

3y 

rrom 

t ime  o 1 

4> . 


"backwards  time"  variable  t  defined  by  x  =  T  -  t  and  obtain 
dPi  S! 


dx  v2  R 


p^(x  =  0)  -sin  u, 


dp2  si 

___  =  _p^  $  p2(t  .  o)  =  cos  u. 


We  combine  these  equations  to  obtain  a  second  order  differential 
equation  for  p^  as  follows 


d?PI  _  dPJ.  SI  a  A  A 

dr7  df  R  ^  =  "P1(R  ^  * 


or 


dS  -1 

dP“  +  <R-  ♦>  P1  “  °- 


The  solution  to  the  above  equation  is  given  by 


S1  S1 

P1(x)  =  A  cos  —  4>t  +  B  sin  —  <j>x , 


I 

I 


I 


i 

i 


i 

§ 

1 
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where  the  constants,  A  ana  B,  are  determined  by 


p^(x  =0)  =  A  =  -sin  u 


dpl  S1 

<ii  (t  -  -  r 


—  <|!P2(t  -  0) 


COS  u 


or 


B  =  -C06  u. 


Hence,  after  some  manipulation,  we  obtain 


P^t)  =  -sin  (u  +  ^=-  $t). 


(D14) 


Similarly,  it  may  be  shown  that 


P2(t)  =  -cos(u  +  4>t). 


(D15) 


Taking  note  of  equation  (D9),  we  also  obtain 

S1  S1 

ain  U»  -  sin(u  +  4>t >  and  cos  ip  =  cos(u  +  —  (jit).  (D16) 

K  K 

Taking  account  of  (D8),  we  obtain  from  the  above  (where  u  refers  to 


angle  at  which  escape  occurs,  see  Figure  Dl) 


5  w2 

ior  U  £  u  <  —  and  -  -  it<  us  2tt  -  U  where  cos  U  =  — 
Z  Z 


and  0  i  lit 


IT 


P1(i)  =  -sin(u  +  —  4>t)  ,  p2(t)  =  -cos (u  +  —  <J>t )  , 


and 


W1  W1 
sin  ip  =  sin(u  +  ^—  ^T)  ,  cos  ip  -  cos(u  +  —  0t)  , 


(D17) 


US) 
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(D24) 
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,  ,  TI  3 

and  for  —  <  u  <  m  v 

x(t)  =  (d  -  xw^lsin  u  ,  y  (t  )  =  (d  -  xw^Jcos  u.  (1)25) 

We  note  that  equations  (D23)  and  (D24)  (and  also  (D17)  and  (D18)) 

hold  from  the  terminal  surface  (x  *  0)  until  a  transition  surface  is 
reached  or  the  trajectory  terminates. 

Equation  of  the  Barrier 

From  the  symmetry  of  problem,  we  consider  the  right  barrier, 
which  terminates  on  the  terminal  surface  with  u  =  w,  where  0  s.  U  < 
and 

cos  U  =  w^/w^.  (D26) 

For  u  =>  U  and  0  s;  t  s  x  ,  we  have  <ji(x)  =  1  (we  show  this  in  the 

next  section)  and  the  barrier  is  given  by 

for  0  s  x  s 

w  w 

x(t)  =  (d  -  Tw^)sin(U  +  — 1  x)  +  R(1  -  cos  “•  x),  (D27) 

rv  i\ 

and 

w  w 

y(x)  =  (d  -  xw  )cos(^  +  rp  x)  +  R  sin  —  x.  (D28) 

c  K  K 

We  now  consider 

w  w: 

R  cos  —  x  =  R  cos  (—  x  +  U  -  U) 

R  K 

wi  w] 

*  R  cos  x  +  U)cos  U  +  R  sin  (xr^x  +  U)  sin  li  . 

R  1 


i 


! 


Using  the  above  and  (D26),  we  obtain 


NJ|  =1 
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WWW  w 

R  cos  -1  i  *=  K  ---  cos(  —  i  +  U)  +  — -  v  -  w i  sin(— •  t  +U), 

K  Wj  K  W^  i  JL  r< 

which  we  combine  with  (027)  to  obtain 

W  W  WWW 

x  ( t  )-R  -  -R  — ' -  cos(“  i+  u)+{[d  -  —  /  w?  -  w^]-(R  —  x}sin(~~x  +  U)  , 

W  K  W  |  X  h  W  ^  K  K 

Similarly 


w  w 

y (t )  «  (R  ~)sin(~  i  +  u)+( 


,  R  / - 7 - 2 

d  -  —  *  wf  -  w: 

w  1  2 


w  w  w 

-  (R  — -)“t  >COS  (rp  T  +  . 

K  K 


Recalling  (C30)  and  (C31),  we  see  that  the  above  are  the  equations  of 
an  involute  to  a  circle  of  radius  R  w2/w^  anc*  center  x  ■»  R,y  -  0. 

We  note  that  the  involute  winds  in  for 


d  -  R  /r_-(w2/w1)7  -  w2t  £  0 


(D31) 


Transition  Surfaces 
We  recall  that 


4>  (t )  =  sgn  A(t)  , 


(D4) 


where  A (t )  -  -p^y  +  P2X 
Recalling  that 


x(t  “  0)  “  d  sin  u  ,  y(x  =  0)  =  d  cos  u, 
and  p^(x  =  0)  *  -sin  u  ,  p2(x  *=  0)  =  -cos  u, 


we  see  that 


A(x  **  0)  =  0. 


(032) 


A1  so , 


dA 

dx 


dT 


y  -  Pi 


d  T 


dt 


x  +  p„ 


dx 

dr 


(D29) 


(D30) 
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into  which  v’e  substitute  the  state  and  adjoint  equations  to  obtain 


d_A 

dt 


-p^s j  *=  sin(u  +  with  A(i  ~  0)  “  0. 


Integration  oi  the  above  yields 

R 


A(t ) 


{cos  u  -  cos  (u  +  ■ —  4>x  )}. 

K 


(D33) 


Recalling  (D8)  and  noting  that  for  the  escape  paths  terminating  with 
y  <  u  <  ~  it  the  Pursuer  uses  s^(t)  -  0,  we  see  that  in  this  range 
there  is  no  transition  surface  since  A(t)  s  0  for  all  time.  Hence, 
we  consider  only  paths  for  which  there  is  a  transition  surface,  i.e., 

U  £  u  <  ~  and  —  n  <  u  £  2v  -  k.  In  this  range  of  u  by  (D8)  we  have 
=  Wj  and  (D33)  becomes 


R  1 

A(t)  *=  —  {cos  u  -  cos(u  +  d>T )  }  . 

K 


(D34) 


Thus,  for  0  s  t  s  (where  we  determine  below). 


<Ht) 


{ 


+1  for  U  £  u  <  ~ 


for  —  n  <  u  c  2v  -  li. 


(D35) 


where  U  is  given  by  (D26).  By  the  symmetry  of  the  problem  we  concen¬ 
trate  on  the  right  half-plane.  Consequently,  for  ^  £  u  <  we 
determine  as  follows:  it  is  the  first  time  that  A(t)  =  0  after 

t  «  0.  This  happens  when 


cos  u  ■=  cos  (u  +  T,) 

K  J. 


which  is  precisely  when 


2ti  -  u  =  u  +  x  . 

K  J 
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Hence,  lor  1*  i  u  <  we  have 

tm 

i  -  7R-  (7i  -  u).  (D36) 

1  v1 

1l  appears  as  though  all  trajectories  except  the  barrier  (u  “  U) 
terminate  before  this  time,  however,  because  of  intersection  of 
adjacent  extremals.  Hence,  equation  (036)  becomes 

Ti  -  ~  ("  ~  <D37) 

l  W1 

where  U  is  given  by  (D26).  For  t  >  t  ,  we  show  later  that  A(t)  <  0 
and  hence  <>(t)  -  -1.  We  finally  note  that  (D37)  holds  only  if  the 
barrier  doesn't  terminate  before  this  time  is  reached. 

Termination  of  the  Barrier 

A  fundamental  difference  between  the  homicidal  chauffer  game 
and  the  surveillance-evasion  game  is  that  in  the  latter  the  barrier  may 
terminate  abruptly  before  the  transition  given  by  (D37)  occurs.  We 
recall  (see  Appendix  C)  that  in  the  homicidal  chauffer  game  the  barrier 
terminated  when  $(r)  changed  from  +1  to  -1.  In  the  surveillance- 
evasion  game  we  shall  see  that  for 

d  <  R  {/T-  (w2/w1)‘i  +  2(w2/WiXtt  -U)  ,  (D38) 

the  barrier  terminates  at 

t 2  ”  (d  -  R  sin  (D39) 

Wc  have  investigated  many  aspects  of  this  phenomena  and  will  detail  our 
findings  here. 
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What  led  us  to  our  findings  was  a  statement  by  Dobbie  [14]  which 
we  found  to  be  incorrect.  Let  us  consider  Figure  5  of  the  main  text. 
DoLbie  ([14]  p.  176)  states  that  the  (right)  barrier  can  be  tangent  to 
the  line  through  0  and  D1  (if  d  is  small  enough).  This  was  found 
to  be  incorrect.  Let  be  a  unit  vector  parallel  to  line  connecting 

0  and  D'  and  tobeaunit  vector  orthogonal  to  v^.  Thus 

v^  *  sin  Li-  cos  L  j , 

v^  »  cos  L  i  +  sin  L  j.  (D40) 


We  show  below  that  there  is  a  transition  from 


1  to  <j>  =  -1,  i.e, , 


A(t)  changes  from  positive  to  negative,  at  T ^  =  2R(n  -  U)/w^.  Now 
V‘.  we  will  show  that  we  always  have 


T  =  t  • 


•  V1  =  °, 


(D41) 


i.e.,  the  tangent  to  the  barrier  is  orthogonal  to  the  line  through  0 


and  D'  at  t  =  t^.  Also, 


when  we  have  that 


dX 

dt 


•  v  ■  0  only  for  d  -  t  w  =  R  sin  L, 
dt  j 1=1^  2  J  12 


=  0.  Hence  the  barrier  can  never  be  tangent  to 


this  line.  We  should  note  that  for  t  =  our  new  geometric  construc¬ 
tion  (discussed  below)  shows  that  the  point  (x(t^) ,y (t^) )  of  the 
barrier  always  lies  on  the  line  through  0  and  D'  (if  we  ignore 
termination) . 

To  prove  (D41)  we  consider  (1)  of  the  main  text  at  t  =  2R/w^(n  -  L) 


and 


T=T, 


&L 

dt 


J  T=T, 


— -  (d  -  t  w  )cos  L  -  w  sin  2  L  +  w^sin  L, 

K  JL  Z  x  / 


—  (d  -  r^w^'lsin  L  +  w^  cos  2  L  -  w2cos  L, 


(D42) 
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be  vrttren  as 
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1 

x  (x  )  -  R  ■  (d  -  tw„ ) cos  U  sin  — 
2.  K 

and 

y  (i )  =  -{ (d  -  xw2)sin  U  -  R}sin 
which  we  may  write  as 


1 

t  +  { (D  -  Tw2>sin  U  -  R}cos  x , 


j  1 

—  x  +  (d  -  x w 2 ) c o s  h  cos  — -  x, 


for  0  i  r  S  tj 


x(x)-  R| 

l 

CC  ~  X 

.  1  > 
sin  x 

J'  (d  -  xw^sin  U  -  R 

.  y(r)  j 

.  W1 

[-sin  r  x 

W1 

cos  --  xj 

(d  --  xw2>cos  U 

(D4A) 


Let  us  consider  Figure  5  of  the  main  text.  To  determine  a  point  on  the 

right  barrier  at  time  x  £  2R/w^  (n  -U),  we  start  at  point  A  at  the 

boundary  of  the  detection  region  and  move  to  a  point  which  is  a  distance 

xw2  away  from  A  along  the  straight  line  OA.  We  now  rotate  this 

w 

1 

point  through  an  angle  —  x  in  the  negative  (clockwise)  sense  about 

K 

the  point  x  =  R,y  =  0. 

Some  further  remarks  seem  appropriate.  When  x  =  we  rotate 
through  an  angle  2n  -  2h  in  the  negative  sense  or  an  angle  of  2U 
in  the  positive  sense.  Hence,  any  point  on  the  straight  line  through 
G  and  A  is  carried  to  the  line  through  0  and  D' .  Hence,  our  remark 
about  a  point  of  the  barrier  being  on  OD'  at  x  =  x^.  We  also  see 
the  suggestion  of  anomalous  behavior  if  the  point  moving  along  OA 
passes  the  point  of  tangency  to  the  circle  of  radius  Rw^/w^  and  center 
x  -  R,y  =  0.  If  this  occurs  the  geometry  of  the  situation  tells  us  that 
the  point  of  the  barrier  for  x  =  x^  lies  on  OD'  above  D'  toward 
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the  boundary  of  the  detection  region.  As  the  point  moves  along  OA 
toward  0  before  rotation  we  see  that 

(a)  when  it  is  above  the  point  of  tangency  to  the  circle, 
the  resultant  point  (after  rotation)  is  moving  toward 
tills  circle, 

(b)  when  it  is  at  the  point  of  tangency,  the  resultant  point 
is  on  the  circle  of  radius  Rw^/w^, 

and  (c)  when  it  moves  past  the  point  of  tangency  for  x  <  x^, 
the  resultant  point  moves  away  from  the  circle. 

Again  we  note  that  this  is  because  the  construction  rotates  the  point 
about  x  =  R,v  *  0. 

Algebraically,  we  can  see  the  above  approach  and  recession  by 
considering  (D44)  from  which  we  can  obtain  the  square  of  the  distance, 
denoted  by  D(x),  of  a  point  on  the  barrier  at  x  from  x  =  R,y  -  0 

D(t)  =  (x(x)~  R)2  +  y2(x)  =  (d  -  tw,  -  R)2  +  2R(1  -  sin  U) (d  -  xw^). 

Hence,  for  the  minimum  of  D(x),  we  must  necessarily  have  3  0, 

which  yields 

x 2  s  (d  -  R  sin  Vi)^.  (D45) 

This  value  of  x  does  indeed  yield  a  minimum  since  •— =  2(w2)2  >  0. 

Hence,  we  suggest  that  the  barrier  has  a  cusp  at  such  a  point, 
if  it  occurs.  Let  us  further  note  that  such  behavior  can  occur  on  any 
optimal  trajectory  terminating  on  the  boundary  of  the  detection  region 
for  U  <  u  <  Thus,  it  appears  that  a  trajectory  terminating  at  a 
point  P  on  the  boundary  (if  d  is  right)  similarly  approaches  and 
receeds  from  the  circle  to  which  OP  is  tangent.  We  have  not  had  time 
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to  explore  this  further.  Let  us  note  that  this  doesn't  occur  for 
u  “  We  note  that  for  r 2  to  occur  before  x^  we  muBt  have 

d  -  R  sin  U  <  2R  w2(tt  -  U)/w^ 

or 

d  <  R{sin  U  +  2  w2(r  -  U)/w;L 

which  by  (D26)  is  precisely  the  condition  given  by  (D38). 

Now  that  we  are  suspicious  that  if  (D38)  holds,  the  barrier 
has  a  cusp  in  it  if  it  doesn't  terminate  at  let  us  prove  the 

existence  of  the  cusp  algebraically  before  we  plot  the  curve  of  the 
barrier.  Differentiating  (D23) ,  we  obtain 

w  w  w  w 

<h  “  ~v2  3in(U  +  T^+  r“  {  (d  ~  tw2)cos(U+  x)+  R  sin  ^  t}. 


Noting  that 


W1  W1 

-w„sin(U+  r—  x)+  w.  sin<—  x  +  U  -  U)  • 
Z  R  IK 


w  w  W 

-w  sin(U  +  x)+  w  sin(U  +  ^  x)cos  U  -  w  cost—1  x  +  U)sin  U 

Z  K  1  K  IK 


t  +  ty  sin 

J  K 


where  we  have  used  (D26) ,  we  see  that  (D46)  is  equal  to 

,  w 

—  =  -w^  cos{U+  —  x)  {sinU-(d  -  x  w2)/R}.  (D47) 


(D46) 
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Similarly 

,  w 

sln(U  +  — -  t){sin  U  -(d  -  tw0)/R),  (D48) 

and  hence 

w 

^  ■  -tan(U  +  ~  t).  (D49) 

Thus,  we  see  that  -7^  is  continuous  at  t  =  t„  *  (d  -  R  sin^)/w_. 

dx  2  2 

but  both  and  ^  «=  0  at  t  «=  and  change  sign  as  t  passes 

through  1 2 »  Hence,  the  barrier  curve  y  =  y(x)  has  a  cusp  at  t  *  1^. 
Thus,  the  barrier  must  terminate  (see  Appendix  B  for  discussion)  and 
(D38)  and  ( D 39 )  have  been  proved. 

Another  way  to  see  this  is  to  consider  (D29)  and  (D30) .  From  the 
discussion  of  the  involute  in  Appendix  C,  we  see  that  the  involute 
winds  in  for 


d  -  R/f  -(w2/w1)z‘  -  (R 


t)  2  0. 


Therefore  if 

T  «  J-2  0T  -U), 

1 

doesn't  occur  before  the  involute  touches  the  circle  with  radius 

R  the  involute  starts  to  unwind.  But  for  this  to  hold,  (D38) 

follows  immediately.  We  note  that  the  involute  unwinds  for 

w  w 

{ [d  -  r/F-(w,/w T)7]  -  (R  — )(^  t)}  <  0. 

L  1  K 

Figure  D2  shows  the  cusp  which  would  occur  if  barrier  didn't 
terminate.  The  values  of  parameters  which  were  used  to  calculate  the 
curve  are  shown  on  the  figure. 
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Continuation  of  Solution  Past  Transition  Point 

It  may  be  shown  that  when  barrier  does  not  terminate  (see  (D38)) 

other  extremals  Intersect  before  x  *■  x  and  hence  terminate,  so  we 
the 

consider  just ^(right)  barrier.  From  (D17),  we  have 

P1^T1^  "  sln  ^  *  p2^t1^  "  -cos  ^  ' 

From  (D27)  and  (D28) ,  we  obtain 

x(tj)  =  (d  -  t^w^lf-sin  U)  +  R(1  -  cos  2  U) , 

l 

...w  y(x^)  =  (d  ~  x^w^)  cos  ^  -  R  sin  2  ^  .  (50) 

Later,  we  show  that  <J>(t)  =  -1  for  t  >  x^.  We  assume  this  for  now. 
The  adjoint  equations  for  x  >  x^  are 

dpl 

dr-  "  _P2W]/R  pi (t^)  “  sin  U  » 
dp2 

=  P1W]./R  P2(T15  =  _C0S  U  ’ 

The  solution  to  the  above  equations  is  (for  x  >  x.) 

w 

p^x)  =  sin(U  +  ^(x  -  x^))  =  -sin  ip , 

W1 

p.,(x)  =  -cos(U  +  —  (x  -  x,))  =  -cos  ip.  (51) 

Z  K  1 

The  state  equations  for  t  > 


are 
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-  ^  y  +  w2  sin(U+  ^(t  -  x^), 

W1  W1 

X  +  w,  -  w2  cos (U  +  — (t  -  T^)), 

with  initial  conditions  given  by  (D50).  A  rather  laborious  computation 
(we  omit  the  details)  yields  the  solution  to  the  above  as  (for  t  >  x^) 

w 

x(t)  =  - (d  -  tw2)sin(U  +  ~  (i  -  x1>) 

w  w 

+  R{ 2  cos  ^(x  -  T1>-  1  -  cos (2  (t  -  Xj))}, 

am) 

w 

y (t)  -  (d  -  tw2)cos(U  +  -  x^) 

w  w 

+  R{2  sin  ^(x  -  Tl)-  sin(2  U  +  — (x  -  x^)}.  (52) 


dx 

dx 


dx 


We  may  write  equations  (D52)  as  (for  x  >  x^) 


w  w 


x(x)+R 

cos  ^=-(t-t^)  U 

-sin  jj— (x-t^) 

(d-xw2> (-sin  U)+  2R  -  R  cos  2^ 

y(x) 

W1 

[sin 

W1 

cos  ^-(x-x.^) 

(d-xw2)cos  U  -  R  sin  2U 

or  using  (D50) 


x(t)+R 

r  1  i 

cos  --(x-T1)  -sin  ^-(x-x.^) 

x(xi)+  W2(t-X1)cOS(^  -  U)  +  r 

* 

w,  w. 

.  y(t) 

sin  —  (t-t  )  cos  =-(t-t  ) 

y(t  )-w  (x-T.)sin(y-U) 

(D53) 


.  (054) 
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The  most  important  aspects  of  the  geometric  interpretation  of 
(1)54)  are  that  rotation  is  in  tiie  positive  (counter-clockwise)  sense 
about  the  point  x  «  -R,y  “  0  and  the  involute  unwinds.  That  (D52) 
does  Indeed  trace  out  an  involute  may  be  seen  by  writing  it  in  the 
equivalent  form 


w  « 

x(t)  +  R  *  R  —  cos (U  +  (x  -  r  )) 

K  .L 


+  [  {  3r/i  -(— 


.  •  -dl<  <R^)('r>  9l»'u  +  r(' -  V1’ 


/  W  2  W  W  W 

y(T)  *  -  [{3R/1  -  (--)  -  d)  +  (R^)(t  ^)]cos(U  +  ^(t  -  T1)) 


-  R 5ln<u  +  r<’  -  V>- 


(D55) 


w 

2 

'Which  is-  the  involute  to  a  circle  of  radius  R  —  and  with  center 

W1 

x  »  -R,v  -  0. 


Shape  of  the  Surveillance  Region 

When  a  surveillance  region  does  exist,  it  may  take  on  one  of  two 
shapes  depending  on  whether  or  not  the  barrier  terminates  by  intersect¬ 
ing  the  negative  y-axis.  These  two  possibilities  are  shown  in  Figure 
5  and  6  in  the  main  text  where  further  details  are  given.  We  develop 
here  the  condition  for  the  barrier  to  look  like  that  shown  in  Figure  6. 


d  £  R{/1  -(W2/W1)_7  +(w2/wi)(  |  7!  --  U)+  1}, 


(D56) 


Ill 


which  we  may  also  write  as 

d  >  R{/1  -(w^w^  +(w2/w1)sln  ^(-w^w^H  1},  (D57) 

where 

v  £  sin  1(-w2/w1)  £  3/2  tt. 

We  consider  Figure  D3  (which  isn't  drawn  to  scale)  and  recall  the 
relationship  between  two  normals  to  the  Involute  of  a  circle  given  by 
(C32)(see  Appendix  C).  In  Figure  D3,  we  have 

*-1  +  *2  -  *3  ,  (D58) 

i.e.,  the  difference  in  the  length  of  the  normals  is  equal  to  the  distance 
on  the  perimeter  of  the  circle  (evolute)  between  the  points  of  tangency. 
When  the  barrier  intersects  the  negative  y-axis  we  have 

R  S  (D59) 

we  also  have 


A,  »  d  -  l.  or 
3  4 

i  -  d  -  R  sin  U,  (D60) 

and 

*2  *  R  w2^wi  a  •  (D61) 

where 

2(TT  -  U)  =  a  +  e  or  a  =  2*  -  2U  -(ff/2.  -  U), 
or 

a  ■  3/2  it  -  U .  (D62) 
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Combining  (D58),  (D59),  (D60),  (D61) ,  and  (D62) ,  yields 


+  R(w2/Wj)(3/2  ti  -  U)  s;  d  -  R  sin  U  , 


(D6 


which  by  use  of  (D26)  is  seen  to  be  (D56).  Noting  that 


W1  *2 
w2  R 


(3/2  n -  U), 


we  see  that 

W1  *2 

sinf —  -~1  m  -  cos  U  “  -  w„/w, , 

^2  R  '  21 

and  hence 

12  =(Rw2/w1)sin  1(-w2/w1>  , 

which  leads  to  (D57), 

Absence  of  Singul ar  Solution 

Unlike  the  problems  considered  In  Appendices  B  and  C,  there  does 
not  appear  to  be  a  singular  solution  to  this  problem. 

Another  Way  to  Determine  UP 

We  have  seen  (see  Appendix  B)  that  the  useable  part  of  the  terminal 

•  “V  ■+ 

surface  may  be  determined  from  X  •  n  s  0,  where  n  is  a  unit  normal 

vector  to  the  terminal  surface  and  points  into  the  state  space.  Another 

criterion  used  by  Isaacs  ([30]  p.  239)  In  a  capture  game  is  that  the 

UP  is  determined  by  4y(t2)  £  0,  where  x2  +  y2  =  r2.  For  the  escape 

at 

problem  at  hand,  this  condition  becomes 


114 


(r  i" )  >  0,  (D64) 

r=J 

[We  n..(  lli. ii  thl-.  ..million  in  exam  l  imil  only  on  the  terminal  surface 
an!  that  optimal  strategies  are  not  Jet'- rir,  1  nod  by  the  rate  of  change 
o!  range  as  one  might  Inter  iron  hobble  [14]  pp.  175-1/6  (see  [30] 

p  :  .  20'i-20fj)  .  ] 

Using  (l.i  and  (!)1Q),  we  obtain  f  rom  (1)64) 

w  (x  sin  v  -t  v  cos  v)~  s  v  >  0,  (D6 5 ) 

*>  1 

which  becomes  lor  i  -  0  and  using  (D20) 

dw0(sin‘  u  +  cos*1  u)  2-  s^d  cos  u,  (  ' 

whence  let  ring  =  w 

w  -  w  cos  u  2.  0,  (D66) 

•  — ^ 

which  is  the  same  result  as  from  '  n  £  0. 

b.  The  Sew_ Geometrical  Construction  for  Optimal  Trajectories. 

We  consider  optimal  trajectories  in  the  right  halt-plane  for 
0  £  i  £  «  ZR-'Wj  (r  -  u)  and  U  <;  u  <■  x/2,  c.os  u  =  w^/w^.  Background 

riatori-.il  is  to  be  found  in  Appendix  B.  For  0  £  x  £  x^,  we  have  that 
>?(:)  =  1,  and  by  (1)2 3)  and  (1)24)  we  have 

I 

vl  W1 

x(t)  -  K  =  (d  -  lu  )cos  u  sin  -  t +  { (d  -  xw  )sin  u  -  K}cos  x, 

*.  K  <.  K 

and 

w,  Wl 

y(.)  =  -  {(J  -  iw.jisin  u  -  R.'sin  R'"  x  (d  -  xw^lcos  u  cos  —  i,  (D67) 

5 

i 


\ 
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which  we  may  write  as 

for  U  S  u  <  n/2  where  cos  U  =  «2/w^  and  0  &  t  si  t  ^ 


x(t)~  R 

.  y(i>  . 

cos  --  i  sin  -R-i 


(d  -  TW^sin  u  —  r"| 


(d  -  tw2)cos  u 


(D68) 


Equation  (D68)  appears  in  the  main  text  as  (3).  The  geometric  interpre¬ 
tation  of  these  equations  follows  equation  (3)  in  the  main  text. 

Considering  the  geometric  interpretation  of  (D68) ,  we  see  that 
the  Involute  winds  in,  i.e.,  radius  of  curvature  decreases  with 
increasing  r,  for  0  £  x  <:  Further  geometric  investigations 

have  shown  tnat  neighboring  extremals  intersect  (see  Figure  3).  This 
means  that  on  on  extremal  there  is  a  point  conjugate  to  t  =  0  and 
that  the  trajectory  terminates  here  (except  for  the  barrier).  Time  has 
not  permitted  Uhls  to  be  more  fully  investigated. 


( ' 

c .  Ceometry  _of_  the  So lution  . 

This  topic  is  discussed  in  section  1 3  Id  of  the  main  te:  t . 
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APPENDIX  I. 

SOME  ALLOCATION  OK  SEARCH  EFFORT  RESULTS 
BY  THE  I’ONTRY  AG  IN  MAXIMUM  PRINCIPLE 

A  major  problem  in  Naval  warfare  i  ;  the  search  for  targets  at  sea. 

Hence,  the  optimum  allocation  of  search  effort  is  of  interest  in  developing 
tactics.  We  show  in  this  appendix  that  some  well-known  results  in  the 
optimum  allocation  of  search  effort  may  be  more  easily  obtained  by  appli¬ 
cation  of  the  Pontryagin  maximum  principle  [A3]  sad  the  "sharpness"  of 
the  results  extended  slightly.  We  begin  by  reviewing  briefly  the  litera¬ 
ture  . 

Koopman  wrote  the  first  major  work  on  search  theory  [35]  ,  which  was 
for  a  long  time  classified  (until  May  10,  1961).  It  still  remains  a 
major  work,  especially  remarkable  for  containing  many  of  the  concepts  for 
research  being  performed  20  years  later.  Som  examples:  formulation  of  non¬ 
linear  programming  problem  for  searching  ocean  aresn,  Sayssian  approach  to 
sequential  search.  Later,  Professor  Koopman  published  sow.®  of  these  results 
in  the  open  literature  [36],  [3V],  [38].  In  [38J,  Kocpm.au  solved  the  problem 
for  a  continuous,  one-dimensional  model  o:f:  the  optimum  >Ust r.'iW.cio;.  of  search 
density  when  the  conditional  probability  ;»f  detecting  the  target  is  exponrui- 
tial.  However,  it  should  be  noted  that  Chapter  5  of  [35]  contains  much  \  1 
material  not  in  [38].  For  example,  in  [Ty  Koopman  first  solves  a  discrete 
problem  of  searching  effort,  discusses  the  physical  interpretation  of  various 
quantities  and  the  structure  of  the  solution,  and  ttien  extends  this  to  the 
case  where  targets  are  continuously  distributed  (two-dimensional). 

Charnes  and  Cooper  [10]  extended  [38]  by  formulating  a  non-linear 
programming  model  for  searching  discrete  alternatives.  They  solved  this 
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model  by  applying  the  Kuhn-Tucker  conditions.  De  Guenin  [13]  extended 
Koopman's  results  [38]  by  considering  the  optimum  distribution  of  search 
density  for  a  general  conditional  probability  of  target  detection  (he 
assumed  this  to  be  a  concave  function  of  search  density). 

We  now  derive  the  solution  to  Koopman's  problem  [38]  and  de  Guenin's 
[13]  by  the  maximum  principle.  The  reader  is  directed  to  these  papers  for 
model  formulation.  Even  though  Koopman's  problem  is  a  special  case  of 
de  Guenin's,  there  still  appears  to  be  methodological  value  in  considering 
it  first. 


a .  Koopman's  Problem. 

The  problem  studied  by  Koopman  may  be  stated  as  to  maximize  target 
detection  probability  when  there  is  a  restriction  on  the  total  amount  of 
search  effort  available.  Mathematically,  the  problem  may  be  stated  as 


maximize 

<f> 


p(x){  1  -  e-^  ^ )  dx  , 

—00 


subject  to: 


i  <j>  (x)  dx  =  4>  , 

J  —CD 


and  (x)  >_  0  , 

where 


(El) 


p (x)dx 


1 


— <j*  (x) 
e 


4>(x) 


Frob[ target  located  between  x  and  x  +  dx  ]  , 

Profcfdetect  tacget  with  effort  <f(x)|  target  located  at  x  ]  , 
is  search  density  and  defines  the  distribution  of  search  effort. 


$ 


and 


is  total  search  effort. 
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We  note  that 


p(x)  dx  =  1  and  p(x)  >_  0 

— oo 


We  now  consider  the.  following  equivalent  optimal  control  problem: 

•  CX5 

maximize  |  p(x){l  -  e  }  dx  , 

,Jl  J  —  4» 


subject  to: 

dy /dx 

■=  if  (x)  , 

where 

(x) 

>  0  , 

and 

y(x  * 

— oo)  *  0 

Hamiltonian 

for  this  p 

roblem  is 

H(x,y,X ,40 

“  p(x){l  - 

e’*(x)> 

)  =  0  and  y (x  =  +“)  =  $ 


+  l<i>(x)  , 

where  X  is  the  dual  variable  corresponding  to  the  state  equation. 

►CO 

Defining  J*  as  equal  to  max  p(x){l  -  e  ^  x  }dx  ,  we  see  that 

<*  —<K 


(E2) 


<E3) 


X  =  9 J*/9y  <  0  , 

fX 

since  v(x)  is  cumulative  effort  (v(x)  «  I  <j>(x)  dx)  and  by  expending 

J  —  00 

more  effort  than  is  optimal  we  can  do  nothing  but  reduce  the  optimum  target 
detection  probability.  By  the  condition 


dA  _  _  3JK  = 
dx  3y  , 

we  see  that  X (x)  is  a  constant. 

The  optimum  distribution  of  search  effort  is  found  by  maximizing  the 
Hamiltonian  with  respect  to  the  control  variable  $  ,  which  is  the  search 


density.  To  facilitate  a  later  argument,  we  let  A 
Then,  the  Hamiltonian  is  maximized  by 
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«>  -|i  where  p  >  0  . 

3H/3<t>  =  p(x)e~^“^  -  p  *  0  for  <J)(x)  >  0  > 

or 

3H/3tf>  <  0  for  i()(x)  =  0 

Since  3^H/34>2  -  -p(x)e  <  0  for  all  x  and  ij>(x)  <  00  ,  we  see  that 

sufficient  conditions  for  a  global  maximum  are  satisfied,  i.e.,  is 

concave.  Thus,  we  see  that  the  optimum  distribution  of  search  effort  is 
determined  as  follows: 

(a)  for  p(x)  <  y,  $(x)  =  0  ,  since  then  p(x)e  <  p  or  3H/941  <  0  , 

(b)  for  p(x)  >_  p,  <j>  (x)  “  ln(p(x)/p)  ,  since  p(x)e^  "  p  yields 

3H/3ij>  =  0  <E4) 

We  determine  p  as  follows.  Define  £1  =  {x|p(x)  >_  p}  .  Then  p  is  chosen 

so  that 

Jhi(p(x)/p)dx  = 

a 

When  the  appropriate  sufficient  conditions  (see  [9]  pp.  181-182)  are  checked, 
i.e.  strengthened  Weierstrass,  strenjfhened  Legendre,  and  Jacobi,  it  is  found 
that  (E4)  is  both  necessary  and  sufficient, 
b.  De  Guenin's  Problem. 

Here,  we  consider  a  more  general  conditional  probability  of  target 


detection.  The  problem  is 
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where  p(x)  ,  f(x),  and  v  art  defined  as  before  and 

h(f(x))  =  Prob[detect  target  with  effort  if  (x)  |  target  is  at  x  ]  . 

I)e  huetiin  further  assumes  that  h(f>)  is  concave  with  h’(<f  =  0)  0  , 

i.e.,  h'(f>)  »  dh/dif  is  marginal  return  of  conditional  detection  probability 
with  search  effort.  Diminishing  returns  may  be  stated  as  h"(if)  <  0  with 
dh/dif  (v  =  0)  >  0  and  dh/df  (if  *>  *)  =  0  .  It  is  noted  that  the  condition 
ti"(f)  <  0  for  all  if  implies  that  the  inverse  of  h'(<f).  i.e.  h'  1  ,  is 
well-defined. 

Again,  we  consider  an  equivalent  optimal  control  problem: 

#0° 

maximize  p(x)h(if(x))  dx  , 

0  — «> 


subject  to: 

dy/dx  “  if(x) 

where 

if  (x)  ■»  0 

and 

y ( x  =  -»)  = 

0  and  y(x  =  4<*)  » 

(E6) 

The  Hamiltonian 

for  this  problem 

is 

(E7) 


H(x  ,  y ,  X  ,if  )  =■  p  (x) h  (<f-  (x)  )  +  Xif(x)  , 


where,  as  before,  the  dual  variable,  1  , 


will  turn  out  to  be  negative 


X  «=  3 J*/3y  <  0 


As  before, 


dX/dx  =  -3H/3y  =  0  , 


so  the  dual  variable  is  a  constant,  which  we,  for  convenience,  set  equal  to 
-Vi  where  y  >  0  .  Maximization  of  the  Hamiltonian  with  respect  to  the 
control  variable  <f>  is  determined  by 


311/3$  =  p(x)h'(4')  -  y  -  0  for  $(x)  >  0  , 

or 

3H/3<(>  <0  for  4>(x)  -  0  , 


which  is  sufficient  for  a  global  maximum,  since 

3^H/3<fi^  =  p(x)h"($)  <  0  for  all  x  and  ^(x)  . 

We  determine  the  desired  search  density,  $  ,  as  follows! 

DH 

(a)  for  p(x)h’($  =  0)  <  y,  $(x)  =  0  ,  since  then  — 

(b)  for  p(x)h'(4>  -  0)  >_  y,  <t>(x)  =  h’  ^(y/pCx))  ,  since 


4>=0 


h’($) 


0  , 

=  y/p(x) 


yields  “  =  0  ,  (E3) 

where  y  ic  determined  similarly  to  the  previous  case.  It  is  easily  shown 
that  (E8)  are  both  necessary  and  sufficient  for  the  optimum  distribution 
of  search  effort.  Thus,  we  have  shown  that  de.  Guenir’s  results  are  also 
sufficient  for  the  determination  of  optimum  search  effort. 
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c.  kxt  fusions . 

Here,  we  iiii'iit  i  i'll  somi  oslwibions  of  either  analysis  or  models  to  the 
above.  It  cun  In'  shown  that,  the  above  results  may  be  developed  strictly 
within  the  framework  of  the  classical  calculus  of  variations  (and  in  a 
different  way  than  reported  in  the  literature)  but  this  analysis  has  not 
been  completely  documented  at  this  time.  Besides  the  trivial  extension  to 
h  °  h(x,>(x))  ,  already  noted  bv  de  tluenin,  we  may  extend  the  maximum 
principle  approach  to  some  cases  where  h(^)  is  not  concave. 


V- 
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The  kinematic  aspect  of  surveillance-evasion  is  studied  with  a  deterministic 
differential  game  model.  The  model  considers  a  Pursuer  with  limitations  on 
both  speed  and  maneuverability  (turning  radius)  and  an  Evader  with  only  a 
speed  limitation.  Conditions  are  developed  for  the  Pursuer  to  be  able  to 
maintain  contact  indu2j.nii.ul>.  The  r—dt^  ^  *’,is  research  modify  previously 
published  results  on  this  pioolem.  Shortcomings  of  previous  work  are 
discussed  including  the  fact  that  the  surveillance-evasion  problem  has  not 
been  solved  for  an  arbitrary  detection  region.  Related  parts  of  the  solution 
to  Isaacs'  homicidal  chauffeur  game  and  its  one-sided  counterpart  are  developed 
as  background  material.  Some  known  allocation  of  effort  in  search  theory 
results  are  derived  by  the  Pontryagin  maximum  principle. 
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